<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix"><tt>Hi Kevin,<br>
<br>
Indeed, it looks compiled ok now (with the memory debugger).
Keep in mind to set (in this order):<br>
mem_log=4<br>
mem_dump=1<br>
to avoid runtime logs, but to get the mem dumps.<br>
<br>
Regards,<br>
</tt>
<pre class="moz-signature" cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a class="moz-txt-link-freetext" href="http://www.opensips-solutions.com">http://www.opensips-solutions.com</a></pre>
On 04.07.2014 12:41, Kevin Mathy wrote:<br>
</div>
<blockquote
cite="mid:CAOmzhX=uXKG5o7BCXro+4Punfb7RDrdhmpvBAESgZ5tVV_CmTg@mail.gmail.com"
type="cite">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>We've recompiled OpenSIPS with requested modules (I think)
:</div>
<div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">root@asbc2:/home/kemathy#
opensips -V<br>
version: opensips 1.9.2-notls (x86_64/linux)<br>
flags: STATS: On, USE_IPV6, USE_TCP, DISABLE_NAGLE,
USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, <b>DBG_QM_MALLOC</b>,
FAST_LOCK-ADAPTIVE_WAIT<br>
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144,
MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535<br>
poll method support: poll, epoll_lt, epoll_et, sigio_rt,
select.<br>
svnrevision: unknown<br>
@(#) $Id$<br>
main.c compiled on 22:12:10 Jul 3 2014 with gcc 4.7</blockquote>
</div>
<div><br>
</div>
<div>Now we'll keep an eye on our server to check if everything
is OK, and if the memory error still occur; as we upgraded
from 1.9.1 to 1.9.2...</div>
<div><br>
</div>
<div>I'll get back to you with some logs if needed ;-)</div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien cordialement, </span></div>
<div><span style="font-weight:normal">Best Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-07-02 9:37 GMT+02:00 Kevin Mathy <span
dir="ltr"><<a moz-do-not-send="true"
href="mailto:k.mathy@hexanet.fr" target="_blank">k.mathy@hexanet.fr</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>Hummm, right, opensips doesn't seem to have been
compiled with the requested modules for memory
debugging... </div>
<div><br>
</div>
<div>
<div class="">
<blockquote class="gmail_quote" style="margin:0px 0px
0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">root@asbc2:/home/kemathy#
opensips -V<br>
version: opensips 1.9.2-notls (x86_64/linux)<br>
flags: STATS: On, USE_IPV6, USE_TCP, DISABLE_NAGLE,
USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC,
DBG_F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT<br>
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE
262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE
65535<br>
poll method support: poll, epoll_lt, epoll_et,
sigio_rt, select.<br>
svnrevision: unknown<br>
@(#) $Id$<br>
main.c compiled on 11:15:37 Jun 20 2014 with gcc 4.7</blockquote>
<div><br>
</div>
</div>
<div> So I think I'll have to re-compile opensips
with QM_DBG_MALLOC, and try again to export the
memdump log...</div>
</div>
<div><br>
</div>
<div>I'll get back to you when done.</div>
<div><br>
</div>
<div>
Thanks a lot for your help !</div>
<div><br>
</div>
<div>Kevin</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">
<div class=""><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div>
<span style="font-weight:normal">Best Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
</div>
<div class="gmail_quote">2014-07-01 17:31 GMT+02:00
Bogdan-Andrei Iancu <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:
<div>
<div class="h5"><br>
<blockquote class="gmail_quote" style="margin:0px
0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi Kevin,<br>
<br>
Unfortunately the logs are not correct - are
you sure you properly compiled the mem debug
? like adding the QM_DBG_MALLOC and removing
the FM_MALLOC flags ? As the logs show the
standard memory manager (without debugging).<br>
Check it with "opensips -V" to see the list
of compiled flags.<br>
<br>
I tried to get some ideas by only looking at
the available memory and how many fragments
were allocated in each process - indeed,
there are some processes using maybe like 2
or 3 times more PKG, but not sure if a leak.<br>
Getting the proper logs (which will be huge)
will tell us more.
<div><br>
<br>
Regards,<br>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a moz-do-not-send="true" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div> On 01.07.2014 18:11, Kevin Mathy
wrote:<br>
</div>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>
<div>I have now a memdump log, as we
restarted opensips this afternoon for
a configuration maintenance... But the
file is too big, even if I try to put
it to <a moz-do-not-send="true"
href="http://pastebin.com"
target="_blank">pastebin.com</a> ...
So, here is the file; I don't want to
give the link on the mailing-list :-) </div>
</div>
</div>
</blockquote>
<br>
[removed]<br>
<br>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div>I hope this will help
understanding our problem's cause
:-) ...</div>
<div><br>
</div>
<div>Thanks for your help, </div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span
style="font-weight:normal">Bien
cordialement, </span></div>
<div><span
style="font-weight:normal">Best
Regards, </span></div>
<div><span
style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-30
16:30 GMT+02:00 Kevin Mathy <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:k.mathy@hexanet.fr"
target="_blank">k.mathy@hexanet.fr</a>></span>:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>Ooops, I thought my two
first mails have been
cancelled :-)</div>
<div>I prefer waiting till
there's no traffic, so I'll
send a SIGUSR1 comme this
evening, and reply to this
topic with the log.</div>
<div><br>
</div>
<div>I'll try working with MI
statistics to make some memory
usage graphs better than with
Cacti... </div>
<div><br>
</div>
<div>I'll come back to you with
logs; thanks for all !</div>
<div><br>
</div>
<div> Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra">
<div><br clear="all">
<div><b>
<div><span
style="font-weight:normal">Bien
cordialement, </span></div>
<div><span
style="font-weight:normal">Best
Regards, </span></div>
<div><span
style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
</div>
<div class="gmail_quote">2014-06-30
11:54 GMT+02:00 Bogdan-Andrei
Iancu <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:bogdan@opensips.org"
target="_blank">bogdan@opensips.org</a>></span>:
<div>
<div><br>
<blockquote
class="gmail_quote"
style="margin:0px 0px
0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF"
text="#000000">
<div><tt>Hi Kevin,<br>
<br>
There is no need
to send your email
three times ;).
One time is
enough.<br>
<br>
Waiting and taking
the dump when
there is not
traffic is good
(but not a must) -
the idea is to be
sure that all
temporary memory
(used for
processing the
current traffic)
was freed - so
what you still
have in memory is
configuration data
or possible leaks.<br>
If you do not have
the luxury of
waiting, you can
do it whenever you
can.<br>
<br>
Once again, do not
look at the memory
usage reported by
OS - it is
irrelevant as
OpenSIPS is doing
its own internal
memory management.<br>
<br>
Check the memory
usage via MI, see
the mem related
statistics:<br>
<a
moz-do-not-send="true"
href="http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11"
target="_blank">http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11</a><br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a moz-do-not-send="true" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On
30.06.2014
12:01, Kevin
Mathy wrote:<br>
</div>
</div>
</div>
<blockquote
type="cite">
<div>
<div>
<div dir="ltr">
<div
style="font-family:arial,sans-serif;font-size:13px">Hi
Bogdan,
<div><br>
</div>
<div>If I want
to send a
SIGUSR1, may I
have to wait
20 minutes
after the last
call ? 20
minutes
without any
call ? I don't
understand
well this
sentence :</div>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> <span>It
is highly
recommended to
do this after
waiting about
20 minutes to
be sure that
as much as
possile memory
is freed - all
temporary
memory used
during
processing is
freed by lack
of load on the
proxy</span></blockquote>
<div><br>
</div>
<div>Also,
last week-end,
the traffic
reduced a lot,
and between
last friday,
when the free
system's
memory was
around 170M,
and this
morning, the
free memory
seems to have
increased :
this morning,
it was around
700M, before
the traffic
comes back.</div>
<div><br>
</div>
</div>
<div
style="font-family:arial,sans-serif;font-size:13px">So,
opensips seems
to well free
the memory,
isn't it ? </div>
<div
style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div
style="font-family:arial,sans-serif;font-size:13px">
Thanks for
your help, </div>
<div
style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div
style="font-family:arial,sans-serif;font-size:13px">Kevin</div>
<div><br>
</div>
<div
class="gmail_extra"
style="font-family:arial,sans-serif;font-size:13px"> </div>
<div
class="gmail_extra"><br
clear="all">
<div><b>
<div><span
style="font-weight:normal">Bien
cordialement, </span></div>
<div><span
style="font-weight:normal">Best
Regards, </span></div>
<div><span
style="font-weight:normal"><br>
</span></div>
</b><b>Kevin
MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div
class="gmail_quote">2014-06-27
10:38
GMT+02:00
Bogdan-Andrei
Iancu <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div
bgcolor="#FFFFFF"
text="#000000">
<div><tt>Hi
Kevin,<br>
<br>
There is no
need to wait
for a crash.
From time to
time, you can
send a SIGUSR1
to a worker
process (or a
process you
suspect as
running out of
pkg mem) ->
the process
will do a pkg
dump to the
log.<br>
<br>
Also, I would
strongly
advice
upgrading to
1.11 (latest
LTS) - 1.9 is
no longer
maintained and
there were
some fixes in
the memory
manager since
then.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a moz-do-not-send="true" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On <a
moz-do-not-send="true"
href="tel:27.06.2014%2010" value="+12706201410" target="_blank">27.06.2014
10</a>:36,
Kevin Mathy
wrote:<br>
</div>
</div>
</div>
<blockquote
type="cite">
<div>
<div dir="ltr">Hi
Bogdan,
<div><br>
</div>
<div>I've set
given options,
and now I'm
waiting for a
new crash of
the service...
Where the
memdump will
be located ?
In another
logfile than
opensips.log,
or in the same
? </div>
<div><br>
</div>
<div>Thanks </div>
</div>
<div
class="gmail_extra"><br
clear="all">
<div><b>
<div><span
style="font-weight:normal">Bien
cordialement, </span></div>
<div><span
style="font-weight:normal">Best
Regards, </span></div>
<div><span
style="font-weight:normal"><br>
</span></div>
</b><b>Kevin
MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div
class="gmail_quote">2014-06-26
18:32
GMT+02:00
Bogdan-Andrei
Iancu <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div
bgcolor="#FFFFFF"
text="#000000">
<div><tt>Kevin,<br>
<br>
Restarting
should not
make you loose
ongoing calls
(even if you
use the dialog
module), do do
not worry on
that.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a moz-do-not-send="true" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
</div>
</div>
<img
moz-do-not-send="true"
src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</div>
</div>
<img moz-do-not-send="true"
src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<br>
<img moz-do-not-send="true"
src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</body>
</html>