<div dir="ltr"><div>version: opensips 2.1.5 (x86_64/linux)</div><div>flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC, FAST_LOCK-ADAPTIVE_WAIT</div><div>ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535</div><div>poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.</div><div>git revision: 39b19dd</div><div>main.c compiled on 19:27:59 Mar 5 2017 with gcc 4.4.7</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 7, 2017 at 4:25 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<tt>What allocator are you using? Can you post the output of 'opensips
-V'?<br>
<br>
Best regards,<br>
</tt><span class="">
<pre class="m_2619109260263126880moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
</span><div><div class="h5"><div class="m_2619109260263126880moz-cite-prefix">On 03/07/2017 12:23 PM, John Nash
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Please note when i call do_routing in such a way
that its unable to find any rules matching and reject call i do
not see free memory drop. But if it finds a route, sends call to
that gateway memory drops with each attempt.</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Mar 7, 2017 at 3:17 PM, John
Nash <span dir="ltr"><<a href="mailto:john.nash778@gmail.com" target="_blank">john.nash778@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">only 6 or 7 calls </div>
<div class="m_2619109260263126880HOEnZb">
<div class="m_2619109260263126880h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Mar 7, 2017 at 3:09
PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> <tt>So I
understand that after ~3K calls, that process
completely runs out of memory?<br>
How many calls have you done before this
trace: <a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-freetext" href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
<br>
Best regards,<br>
</tt><span>
<pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
</span>
<div>
<div class="m_2619109260263126880m_-9028378031016354439h5">
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-cite-prefix">On
03/07/2017 11:32 AM, John Nash wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">when I check stats after a
call attempt pkmem:7-free_size:: 3304280
<div><br>
</div>
<div>In this entry with every call I see
a drop of 1000 bytes around and this
never restores.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Mar 7,
2017 at 2:16 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> <tt>Hi, John!<br>
<br>
Again, this trace doesn't show
any leak.<br>
Are you sure you are having a
private memory leak and not a
shared <br>
memory leak?<br>
<br>
Best regards,</tt><span><br>
<pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
</span>
<div>
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135h5">
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-cite-prefix">On
03/06/2017 08:09 PM, John
Nash wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">here is
another trace
<div><a href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
</div>
<div><br>
</div>
<div>I see lot of alloc
request but no free.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Mar 6, 2017 at 6:57
PM, John Nash <span dir="ltr"><<a href="mailto:john.nash778@gmail.com" target="_blank">john.nash778@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Ok will
try that. Is it
possible that wrong
usage of drouting
may cause this to
happen instead of
actual leak?... What
are the things
private memory is
used for?</div>
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141HOEnZb">
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Mar 6,
2017 at 6:48
PM, Răzvan
Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<tt>Hi, John!<br>
<br>
From the dump
you sent, I
don't see any
leaks. Perhaps
some of those
fragments
increase over
time. Can you
make a memory
dump after the
server runs
some time,
like after it
gets 100
messages?<br>
<br>
Best regards,<br>
</tt><span>
<pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
</span>
<div>
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598h5">
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-cite-prefix">On
03/06/2017
03:02 PM, John
Nash wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Here
is the dump
<div><a href="http://pastebin.com/DTEHF5Vc" target="_blank">http://pastebin.com/DTEHF5Vc</a><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Mar 6,
2017 at 6:20
PM, Răzvan
Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<tt>None of
the "actions"
you are
talking about
have big
impact on
private
memory, but
the shared
one. Better do
the dump and
send it over
to point out
what is
"eating"
memory.<br>
<br>
Best regards,<br>
</tt><span>
<pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
</span>
<div>
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372h5">
<div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-cite-prefix">On
03/06/2017
02:39 PM, John
Nash wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">with
every call
attempt it
decreases. I
tried some
changes by
rejecting
invite before
drouting call
(That means
after auth ,
dispatcher)
and found
memory is
stable but
when drouting
sends Invite
to external
gateway and
external
gateway
rejects it.
Then this
issue happens.
<div><br>
</div>
<div>Inuse
transactions
and active
dialogs also
0. Somthing
wrong
happening in
handling of
failure
replies. But
apart from <span style="background-color:rgb(254,254,238);color:rgb(0,0,0)">use_next_gw
and setting
some avps for
CDR not much
going on
there.</span></div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Mon, Mar 6,
2017 at 5:54
PM, Răzvan
Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<tt>Ok, so it
is the first
listener for
the private IP
that leaks.
Next, is the
memory
stabilizing in
time? Or it is
continously
decreasing?<br>
Yes, that's
how you should
make the dump.<br>
<br>
Best regards,<br>
</tt><span>
<pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a>
</pre>
</span></div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135mimeAttachmentHeader"></fieldset>
<br>
<pre>______________________________<wbr>_________________
Users mailing list
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
</blockquote>
</div></div></div>
______________________________<wbr>_________________
Users mailing list
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</blockquote></div>
</div>
</div></div></blockquote></div>
</div>
<fieldset class="m_2619109260263126880mimeAttachmentHeader"></fieldset>
<pre>______________________________<wbr>_________________
Users mailing list
<a class="m_2619109260263126880moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_2619109260263126880moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
</blockquote>
</div></div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>