<div dir="ltr">only 6 or 7 calls </div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 7, 2017 at 3:09 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    <tt>So I understand that after ~3K calls, that process completely
      runs out of memory?<br>
      How many calls have you done before this trace:
      <a class="m_6794548611486144135moz-txt-link-freetext" href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
      <br>
      Best regards,<br>
    </tt><span class="">
    <pre class="m_6794548611486144135moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_6794548611486144135moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
    </span><div><div class="h5"><div class="m_6794548611486144135moz-cite-prefix">On 03/07/2017 11:32 AM, John Nash
      wrote:<br>
    </div>
    <blockquote type="cite">
      <div dir="ltr">when I check stats after a call
        attempt pkmem:7-free_size:: 3304280
        <div><br>
        </div>
        <div>In this entry with every call I see a drop of 1000 bytes
          around and this never restores.</div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Tue, Mar 7, 2017 at 2:16 PM, Răzvan
          Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> <tt>Hi, John!<br>
                <br>
                Again, this trace doesn't show any leak.<br>
                Are you sure you are having a private memory leak and
                not a shared <br>
                memory leak?<br>
                <br>
                Best regards,</tt><span><br>
                <pre class="m_6794548611486144135m_-5328551591246680141moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_6794548611486144135m_-5328551591246680141moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
              </span>
              <div>
                <div class="m_6794548611486144135h5">
                  <div class="m_6794548611486144135m_-5328551591246680141moz-cite-prefix">On
                    03/06/2017 08:09 PM, John Nash wrote:<br>
                  </div>
                  <blockquote type="cite">
                    <div dir="ltr">here is another trace 
                      <div><a href="http://pastebin.com/9Ge2NEVQ" target="_blank">http://pastebin.com/9Ge2NEVQ</a><br>
                      </div>
                      <div><br>
                      </div>
                      <div>I see lot of alloc request but no free.</div>
                    </div>
                    <div class="gmail_extra"><br>
                      <div class="gmail_quote">On Mon, Mar 6, 2017 at
                        6:57 PM, John Nash <span dir="ltr"><<a href="mailto:john.nash778@gmail.com" target="_blank">john.nash778@gmail.com</a>></span>
                        wrote:<br>
                        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                          <div dir="ltr">Ok will try that. Is it
                            possible that wrong usage of drouting may
                            cause this to happen instead of actual
                            leak?... What are the things private memory
                            is used for?</div>
                          <div class="m_6794548611486144135m_-5328551591246680141HOEnZb">
                            <div class="m_6794548611486144135m_-5328551591246680141h5">
                              <div class="gmail_extra"><br>
                                <div class="gmail_quote">On Mon, Mar 6,
                                  2017 at 6:48 PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                  wrote:<br>
                                  <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                    <div bgcolor="#FFFFFF" text="#000000"> <tt>Hi, John!<br>
                                        <br>
                                        From the dump you sent, I don't
                                        see any leaks. Perhaps some of
                                        those fragments increase over
                                        time. Can you make a memory dump
                                        after the server runs some time,
                                        like after it gets 100 messages?<br>
                                        <br>
                                        Best regards,<br>
                                      </tt><span>
                                        <pre class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                      </span>
                                      <div>
                                        <div class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598h5">
                                          <div class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372moz-cite-prefix">On
                                            03/06/2017 03:02 PM, John
                                            Nash wrote:<br>
                                          </div>
                                          <blockquote type="cite">
                                            <div dir="ltr">Here is the
                                              dump
                                              <div><a href="http://pastebin.com/DTEHF5Vc" target="_blank">http://pastebin.com/DTEHF5Vc</a><br>
                                              </div>
                                            </div>
                                            <div class="gmail_extra"><br>
                                              <div class="gmail_quote">On
                                                Mon, Mar 6, 2017 at 6:20
                                                PM, Răzvan Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                                wrote:<br>
                                                <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                  <div bgcolor="#FFFFFF" text="#000000"> <tt>None
                                                      of the "actions"
                                                      you are talking
                                                      about have big
                                                      impact on private
                                                      memory, but the
                                                      shared one. Better
                                                      do the dump and
                                                      send it over to
                                                      point out what is
                                                      "eating" memory.<br>
                                                      <br>
                                                      Best regards,<br>
                                                    </tt><span>
                                                      <pre class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                                    </span>
                                                    <div>
                                                      <div class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372h5">
                                                        <div class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772moz-cite-prefix">On
                                                          03/06/2017
                                                          02:39 PM, John
                                                          Nash wrote:<br>
                                                        </div>
                                                        <blockquote type="cite">
                                                          <div dir="ltr">with
                                                          every call
                                                          attempt it
                                                          decreases. I
                                                          tried some
                                                          changes by
                                                          rejecting
                                                          invite before
                                                          drouting call
                                                          (That means
                                                          after auth ,
                                                          dispatcher)
                                                          and found
                                                          memory is
                                                          stable but
                                                          when drouting
                                                          sends Invite
                                                          to external
                                                          gateway and
                                                          external
                                                          gateway
                                                          rejects it.
                                                          Then this
                                                          issue happens.
                                                          <div><br>
                                                          </div>
                                                          <div>Inuse
                                                          transactions
                                                          and active
                                                          dialogs also
                                                          0. Somthing
                                                          wrong
                                                          happening in
                                                          handling of
                                                          failure
                                                          replies. But
                                                          apart from <span style="background-color:rgb(254,254,238);color:rgb(0,0,0)">use_next_gw
                                                          and setting
                                                          some avps for
                                                          CDR not much
                                                          going on
                                                          there.</span></div>
                                                          </div>
                                                          <div class="gmail_extra"><br>
                                                          <div class="gmail_quote">On
                                                          Mon, Mar 6,
                                                          2017 at 5:54
                                                          PM, Răzvan
                                                          Crainea <span dir="ltr"><<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>></span>
                                                          wrote:<br>
                                                          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                          <div bgcolor="#FFFFFF" text="#000000">
                                                          <tt>Ok, so it
                                                          is the first
                                                          listener for
                                                          the private IP
                                                          that leaks.
                                                          Next, is the
                                                          memory
                                                          stabilizing in
                                                          time? Or it is
                                                          continously
                                                          decreasing?<br>
                                                          Yes, that's
                                                          how you should
                                                          make the dump.<br>
                                                          <br>
                                                          Best regards,<br>
                                                          </tt><span>
                                                          <pre class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-signature" cols="72">Răzvan Crainea
OpenSIPS Solutions
<a class="m_6794548611486144135m_-5328551591246680141m_-3972373151872949598m_-1935339535774106372m_-8335070280687897772m_5518641707690872261moz-txt-link-abbreviated" href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a>
</pre>
                                                          </span></div>
                                                          </blockquote>
                                                          </div>
                                                          </div>
                                                        </blockquote>
                                                      </div>
                                                    </div>
                                                  </div>
                                                </blockquote>
                                              </div>
                                            </div>
                                          </blockquote>
                                        </div>
                                      </div>
                                    </div>
                                  </blockquote>
                                </div>
                              </div>
                            </div>
                          </div>
                        </blockquote>
                      </div>
                    </div>
                  </blockquote>
                </div>
              </div>
            </div>
            <br>
            ______________________________<wbr>_________________<br>
            Users mailing list<br>
            <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
            <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
            <br>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset class="m_6794548611486144135mimeAttachmentHeader"></fieldset>
      <br>
      <pre>______________________________<wbr>_________________
Users mailing list
<a class="m_6794548611486144135moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_6794548611486144135moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
    </blockquote>
    <br>
  </div></div></div>

<br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>