<div dir="ltr"><div>version: opensips 2.1.5 (x86_64/linux)</div><div>flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC, FAST_LOCK-ADAPTIVE_WAIT</div><div>ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535</div><div>poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.</div><div>git revision: 39b19dd</div><div>main.c compiled on 19:27:59 Mar  5 2017 with gcc 4.4.7</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 7, 2017 at 4:25 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    <tt>What allocator are you using? Can you post the output of 'opensips
      -V'?<br>
      <br>
      Best regards,<br>
    </tt><span class="">
    <pre class="m_2619109260263126880moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
    </span><div><div class="h5"><div class="m_2619109260263126880moz-cite-prefix">On 03/07/2017 12:23 PM, John Nash
      wrote:<br>
    </div>
    <blockquote type="cite">
      <div dir="ltr">Please note when i call do_routing in such a way
        that its unable to find any rules matching and reject call i do
        not see free memory drop. But if it finds a route, sends call to
        that gateway memory drops with each attempt.</div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Tue, Mar 7, 2017 at 3:17 PM, John
          Nash <span dir="ltr"><<a href="mailto:john.nash778@gmail.com" target="_blank">john.nash778@gmail.com</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div dir="ltr">only 6 or 7 calls </div>
            <div class="m_2619109260263126880HOEnZb">
              <div class="m_2619109260263126880h5">
                <div class="gmail_extra"><br>
                  <div class="gmail_quote">On Tue, Mar 7, 2017 at 3:09
                    PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                    wrote:<br>
                    <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                      <div bgcolor="#FFFFFF" text="#000000"> <tt>So I
                          understand that after ~3K calls, that process
                          completely runs out of memory?<br>
                          How many calls have you done before this
                          trace: <a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-freetext" href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
                          <br>
                          Best regards,<br>
                        </tt><span>
                          <pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                        </span>
                        <div>
                          <div class="m_2619109260263126880m_-9028378031016354439h5">
                            <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-cite-prefix">On
                              03/07/2017 11:32 AM, John Nash wrote:<br>
                            </div>
                            <blockquote type="cite">
                              <div dir="ltr">when I check stats after a
                                call attempt pkmem:7-free_size:: 3304280
                                <div><br>
                                </div>
                                <div>In this entry with every call I see
                                  a drop of 1000 bytes around and this
                                  never restores.</div>
                              </div>
                              <div class="gmail_extra"><br>
                                <div class="gmail_quote">On Tue, Mar 7,
                                  2017 at 2:16 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                  wrote:<br>
                                  <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                    <div bgcolor="#FFFFFF" text="#000000"> <tt>Hi, John!<br>
                                        <br>
                                        Again, this trace doesn't show
                                        any leak.<br>
                                        Are you sure you are having a
                                        private memory leak and not a
                                        shared <br>
                                        memory leak?<br>
                                        <br>
                                        Best regards,</tt><span><br>
                                        <pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                      </span>
                                      <div>
                                        <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135h5">
                                          <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141moz-cite-prefix">On
                                            03/06/2017 08:09 PM, John
                                            Nash wrote:<br>
                                          </div>
                                          <blockquote type="cite">
                                            <div dir="ltr">here is
                                              another trace 
                                              <div><a href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
                                              </div>
                                              <div><br>
                                              </div>
                                              <div>I see lot of alloc
                                                request but no free.</div>
                                            </div>
                                            <div class="gmail_extra"><br>
                                              <div class="gmail_quote">On
                                                Mon, Mar 6, 2017 at 6:57
                                                PM, John Nash <span dir="ltr"><<a href="mailto:john.nash778@gmail.com" target="_blank">john.nash778@gmail.com</a>></span>
                                                wrote:<br>
                                                <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                  <div dir="ltr">Ok will
                                                    try that. Is it
                                                    possible that wrong
                                                    usage of drouting
                                                    may cause this to
                                                    happen instead of
                                                    actual leak?... What
                                                    are the things
                                                    private memory is
                                                    used for?</div>
                                                  <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141HOEnZb">
                                                    <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141h5">
                                                      <div class="gmail_extra"><br>
                                                        <div class="gmail_quote">On
                                                          Mon, Mar 6,
                                                          2017 at 6:48
                                                          PM, Răzvan
                                                          Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                                          wrote:<br>
                                                          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                          <div bgcolor="#FFFFFF" text="#000000">
                                                          <tt>Hi, John!<br>
                                                          <br>
                                                          From the dump
                                                          you sent, I
                                                          don't see any
                                                          leaks. Perhaps
                                                          some of those
                                                          fragments
                                                          increase over
                                                          time. Can you
                                                          make a memory
                                                          dump after the
                                                          server runs
                                                          some time,
                                                          like after it
                                                          gets 100
                                                          messages?<br>
                                                          <br>
                                                          Best regards,<br>
                                                          </tt><span>
                                                          <pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                                          </span>
                                                          <div>
                                                          <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598h5">
                                                          <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-cite-prefix">On
                                                          03/06/2017
                                                          03:02 PM, John
                                                          Nash wrote:<br>
                                                          </div>
                                                          <blockquote type="cite">
                                                          <div dir="ltr">Here
                                                          is the dump
                                                          <div><a href="http://pastebin.com/DTEHF5Vc" target="_blank">http://pastebin.com/DTEHF5Vc</a><br>
                                                          </div>
                                                          </div>
                                                          <div class="gmail_extra"><br>
                                                          <div class="gmail_quote">On
                                                          Mon, Mar 6,
                                                          2017 at 6:20
                                                          PM, Răzvan
                                                          Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                                          wrote:<br>
                                                          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                          <div bgcolor="#FFFFFF" text="#000000">
                                                          <tt>None of
                                                          the "actions"
                                                          you are
                                                          talking about
                                                          have big
                                                          impact on
                                                          private
                                                          memory, but
                                                          the shared
                                                          one. Better do
                                                          the dump and
                                                          send it over
                                                          to point out
                                                          what is
                                                          "eating"
                                                          memory.<br>
                                                          <br>
                                                          Best regards,<br>
                                                          </tt><span>
                                                          <pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                                          </span>
                                                          <div>
                                                          <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372h5">
                                                          <div class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-cite-prefix">On
                                                          03/06/2017
                                                          02:39 PM, John
                                                          Nash wrote:<br>
                                                          </div>
                                                          <blockquote type="cite">
                                                          <div dir="ltr">with
                                                          every call
                                                          attempt it
                                                          decreases. I
                                                          tried some
                                                          changes by
                                                          rejecting
                                                          invite before
                                                          drouting call
                                                          (That means
                                                          after auth ,
                                                          dispatcher)
                                                          and found
                                                          memory is
                                                          stable but
                                                          when drouting
                                                          sends Invite
                                                          to external
                                                          gateway and
                                                          external
                                                          gateway
                                                          rejects it.
                                                          Then this
                                                          issue happens.
                                                          <div><br>
                                                          </div>
                                                          <div>Inuse
                                                          transactions
                                                          and active
                                                          dialogs also
                                                          0. Somthing
                                                          wrong
                                                          happening in
                                                          handling of
                                                          failure
                                                          replies. But
                                                          apart from <span style="background-color:rgb(254,254,238);color:rgb(0,0,0)">use_next_gw
                                                          and setting
                                                          some avps for
                                                          CDR not much
                                                          going on
                                                          there.</span></div>
                                                          </div>
                                                          <div class="gmail_extra"><br>
                                                          <div class="gmail_quote">On
                                                          Mon, Mar 6,
                                                          2017 at 5:54
                                                          PM, Răzvan
                                                          Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                                          wrote:<br>
                                                          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                          <div bgcolor="#FFFFFF" text="#000000">
                                                          <tt>Ok, so it
                                                          is the first
                                                          listener for
                                                          the private IP
                                                          that leaks.
                                                          Next, is the
                                                          memory
                                                          stabilizing in
                                                          time? Or it is
                                                          continously
                                                          decreasing?<br>
                                                          Yes, that's
                                                          how you should
                                                          make the dump.<br>
                                                          <br>
                                                          Best regards,<br>
                                                          </tt><span>
                                                          <pre class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a>
</pre>
                                                          </span></div>
                                                          </blockquote>
                                                          </div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </blockquote>
                                                        </div>
                                                      </div>
                                                    </div>
                                                  </div>
                                                </blockquote>
                                              </div>
                                            </div>
                                          </blockquote>
                                        </div>
                                      </div>
                                    </div>
                                    <br>
                                    ______________________________<wbr>_________________<br>
                                    Users mailing list<br>
                                    <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
                                    <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
                                    <br>
                                  </blockquote>
                                </div>
                                <br>
                              </div>
                              <br>
                              <fieldset class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135mimeAttachmentHeader"></fieldset>
                              <br>
                              <pre>______________________________<wbr>_________________
Users mailing list
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_2619109260263126880m_-9028378031016354439m_6794548611486144135moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
    </blockquote>
    

  </div></div></div>


______________________________<wbr>_________________

Users mailing list

<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>

<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>


</blockquote></div>
</div>
</div></div></blockquote></div>
</div>


<fieldset class="m_2619109260263126880mimeAttachmentHeader"></fieldset>
<pre>______________________________<wbr>_________________
Users mailing list
<a class="m_2619109260263126880moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_2619109260263126880moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>

</blockquote>
</div></div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>