<div dir="ltr">Hi Bogdan, <div><br></div><div>Hummm, right, opensips doesn't seem to have been compiled with the requested modules for memory debugging... </div><div><br></div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
root@asbc2:/home/kemathy# opensips -V<br>version: opensips 1.9.2-notls (x86_64/linux)<br>flags: STATS: On, USE_IPV6, USE_TCP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT<br>
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535<br>poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.<br>svnrevision: unknown<br>@(#) $Id$<br>main.c compiled on 11:15:37 Jun 20 2014 with gcc 4.7</blockquote>
<div><br></div><div> So I think I'll have to re-compile opensips with QM_DBG_MALLOC, and try again to export the memdump log...</div></div><div><br></div><div>I'll get back to you when done.</div><div><br></div><div>
Thanks a lot for your help !</div><div><br></div><div>Kevin</div><div class="gmail_extra"><br></div><div class="gmail_extra"><br clear="all"><div><b><div><span style="font-weight:normal">Bien cordialement, </span></div><div>
<span style="font-weight:normal">Best Regards, </span></div><div><span style="font-weight:normal"><br></span></div></b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br><div><div><b><br></b></div></div></div>
<br><br><div class="gmail_quote">2014-07-01 17:31 GMT+02:00 Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi Kevin,<br>
<br>
Unfortunately the logs are not correct - are you sure you properly
compiled the mem debug ? like adding the QM_DBG_MALLOC and
removing the FM_MALLOC flags ? As the logs show the standard
memory manager (without debugging).<br>
Check it with "opensips -V" to see the list of compiled flags.<br>
<br>
I tried to get some ideas by only looking at the available memory
and how many fragments were allocated in each process - indeed,
there are some processes using maybe like 2 or 3 times more PKG,
but not sure if a leak.<br>
Getting the proper logs (which will be huge) will tell us more.<div class=""><br>
<br>
Regards,<br>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre></div><div class="">
On 01.07.2014 18:11, Kevin Mathy wrote:<br>
</div></div>
<blockquote type="cite">
<div dir="ltr">Hi Bogdan,
<div><br>
</div><div class="">
<div>I have now a memdump log, as we restarted opensips this
afternoon for a configuration maintenance... But the file is
too big, even if I try to put it to <a href="http://pastebin.com" target="_blank">pastebin.com</a> ... So, here is
the file; I don't want to give the link on the mailing-list
:-) </div>
</div></div>
</blockquote>
<br>
[removed]<br>
<br>
<blockquote type="cite"><div><div class="h5">
<div dir="ltr">
<div>I hope this will help understanding our problem's cause :-)
...</div>
<div><br>
</div>
<div>Thanks for your help, </div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien cordialement, </span></div>
<div><span style="font-weight:normal">Best Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-30 16:30 GMT+02:00 Kevin Mathy
<span dir="ltr"><<a href="mailto:k.mathy@hexanet.fr" target="_blank">k.mathy@hexanet.fr</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>Ooops, I thought my two first mails have been
cancelled :-)</div>
<div>I prefer waiting till there's no traffic, so I'll
send a SIGUSR1 comme this evening, and reply to this
topic with the log.</div>
<div><br>
</div>
<div>I'll try working with MI statistics to make some
memory usage graphs better than with Cacti... </div>
<div><br>
</div>
<div>I'll come back to you with logs; thanks for all !</div>
<div><br>
</div>
<div>
Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra">
<div><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
</div>
<div class="gmail_quote">2014-06-30 11:54 GMT+02:00
Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:
<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi Kevin,<br>
<br>
There is no need to send your email three
times ;). One time is enough.<br>
<br>
Waiting and taking the dump when there is
not traffic is good (but not a must) - the
idea is to be sure that all temporary memory
(used for processing the current traffic)
was freed - so what you still have in memory
is configuration data or possible leaks.<br>
If you do not have the luxury of waiting,
you can do it whenever you can.<br>
<br>
Once again, do not look at the memory usage
reported by OS - it is irrelevant as
OpenSIPS is doing its own internal memory
management.<br>
<br>
Check the memory usage via MI, see the mem
related statistics:<br>
<a href="http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11" target="_blank">http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11</a><br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On 30.06.2014 12:01, Kevin Mathy
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div style="font-family:arial,sans-serif;font-size:13px">Hi
Bogdan,
<div><br>
</div>
<div>If I want to send a SIGUSR1, may
I have to wait 20 minutes after the
last call ? 20 minutes without any
call ? I don't understand well this
sentence :</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> <span>It
is highly recommended to do this
after waiting about 20 minutes to
be sure that as much as possile
memory is freed - all temporary
memory used during processing is
freed by lack of load on the proxy</span></blockquote>
<div><br>
</div>
<div>Also, last week-end, the traffic
reduced a lot, and between last
friday, when the free system's
memory was around 170M, and this
morning, the free memory seems to
have increased : this morning, it
was around 700M, before the traffic
comes back.</div>
<div><br>
</div>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">So,
opensips seems to well free the
memory, isn't it ? </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">
Thanks for your help, </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">Kevin</div>
<div><br>
</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-27
10:38 GMT+02:00 Bogdan-Andrei Iancu
<span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi Kevin,<br>
<br>
There is no need to wait for
a crash. From time to time,
you can send a SIGUSR1 to a
worker process (or a process
you suspect as running out
of pkg mem) -> the
process will do a pkg dump
to the log.<br>
<br>
Also, I would strongly
advice upgrading to 1.11
(latest LTS) - 1.9 is no
longer maintained and there
were some fixes in the
memory manager since then.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On <a href="tel:27.06.2014%2010" value="+12706201410" target="_blank">27.06.2014
10</a>:36, Kevin Mathy
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>I've set given
options, and now I'm
waiting for a new crash
of the service... Where
the memdump will be
located ? In another
logfile than
opensips.log, or in the
same ? </div>
<div><br>
</div>
<div>Thanks </div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-26
18:32 GMT+02:00
Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Kevin,<br>
<br>
Restarting
should not make
you loose
ongoing calls
(even if you use
the dialog
module), do do
not worry on
that.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
</div>
</div>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</div></div><img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote></div><br></div></div>
<br>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif">