<div dir="ltr">Hi Bogdan, <div><br></div><div>Sounds really good :-) ! I'm going to check if there's no configuration change between 1.9's and 1.11's modules version, and then will upgrade our version ! </div>
<div><br></div><div>I hope this will correct our problem ;-)</div><div><br></div><div>Thanks for your help, </div><div><br></div><div>Kevin</div><div><br></div><div><br></div><div class="gmail_extra"><br clear="all"><div>
<b><div><span style="font-weight:normal">Bien cordialement, </span></div><div><span style="font-weight:normal">Best Regards, </span></div><div><span style="font-weight:normal"><br></span></div></b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div><div><b><br></b></div></div></div>
<br><br><div class="gmail_quote">2014-07-07 18:40 GMT+02:00 Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi Kevin,</tt><tt><br>
</tt><tt><br>
</tt><tt>OK, found the problem. As expected, this was fixed in
1.11, but not ported to 1.9 as this version is not maintained
any </tt><tt>more. Here is the link to the fix for your crash:
<br>
</tt><tt><br>
</tt><tt><a href="https://github.com/OpenSIPS/opensips/commit/eef59c1d7b47ecc35438c01e7dcbdfeea903115a#diff-30710a8823b167e0aae5a14bb4878b75" target="_blank">https://github.com/OpenSIPS/opensips/commit/eef59c1d7b47ecc35438c01e7dcbdfeea903115a#diff-30710a8823b167e0aae5a14bb4878b75</a></tt><div class="">
<tt><br>
<br>
Regards,<br>
</tt>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre></div><div class="">
On 07.07.2014 18:15, Kevin Mathy wrote:<br>
</div></div>
<blockquote type="cite">
<div dir="ltr">Hi Bogdan,
<div><br>
</div><div class="">
<div>Opensips has crashed once again; I hope this time the
memlog will be right to be analysed !</div>
</div><div>Here is the link to download the file : ..................<br>
</div><div><div class="h5">
<div><br>
</div>
<div>If you need further informations, feel free to ask me !</div>
<div><br>
</div>
<div>Thanks for your help, </div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div></div></div><div><div class="h5">
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien cordialement, </span></div>
<div><span style="font-weight:normal">Best Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-07-04 11:54 GMT+02:00
Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi Kevin,<br>
<br>
Indeed, it looks compiled ok now (with the memory
debugger). Keep in mind to set (in this order):<br>
mem_log=4<br>
mem_dump=1<br>
to avoid runtime logs, but to get the mem dumps.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On 04.07.2014 12:41, Kevin Mathy
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>We've recompiled OpenSIPS with requested
modules (I think) :</div>
<div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">root@asbc2:/home/kemathy#
opensips -V<br>
version: opensips 1.9.2-notls (x86_64/linux)<br>
flags: STATS: On, USE_IPV6, USE_TCP,
DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP,
PKG_MALLOC, <b>DBG_QM_MALLOC</b>,
FAST_LOCK-ADAPTIVE_WAIT<br>
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE
262144, MAX_LISTEN 16, MAX_URI_SIZE 1024,
BUF_SIZE 65535<br>
poll method support: poll, epoll_lt, epoll_et,
sigio_rt, select.<br>
svnrevision: unknown<br>
@(#) $Id$<br>
main.c compiled on 22:12:10 Jul 3 2014 with
gcc 4.7</blockquote>
</div>
<div><br>
</div>
<div>Now we'll keep an eye on our server to check
if everything is OK, and if the memory error
still occur; as we upgraded from 1.9.1 to
1.9.2...</div>
<div><br>
</div>
<div>I'll get back to you with some logs if needed
;-)</div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-07-02 9:37 GMT+02:00
Kevin Mathy <span dir="ltr"><<a href="mailto:k.mathy@hexanet.fr" target="_blank">k.mathy@hexanet.fr</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>Hummm, right, opensips doesn't seem to
have been compiled with the requested
modules for memory debugging... </div>
<div><br>
</div>
<div>
<div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">root@asbc2:/home/kemathy#
opensips -V<br>
version: opensips 1.9.2-notls
(x86_64/linux)<br>
flags: STATS: On, USE_IPV6, USE_TCP,
DISABLE_NAGLE, USE_MCAST, SHM_MEM,
SHM_MMAP, PKG_MALLOC, DBG_F_MALLOC,
FAST_LOCK-ADAPTIVE_WAIT<br>
ADAPTIVE_WAIT_LOOPS=1024,
MAX_RECV_BUFFER_SIZE 262144,
MAX_LISTEN 16, MAX_URI_SIZE 1024,
BUF_SIZE 65535<br>
poll method support: poll, epoll_lt,
epoll_et, sigio_rt, select.<br>
svnrevision: unknown<br>
@(#) $Id$<br>
main.c compiled on 11:15:37 Jun 20
2014 with gcc 4.7</blockquote>
<div><br>
</div>
</div>
<div> So I think I'll have to re-compile
opensips with QM_DBG_MALLOC, and try
again to export the memdump log...</div>
</div>
<div><br>
</div>
<div>I'll get back to you when done.</div>
<div><br>
</div>
<div> Thanks a lot for your help !</div>
<div><br>
</div>
<div>Kevin</div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">
<div><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div> <span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
</div>
<div class="gmail_quote">2014-07-01 17:31
GMT+02:00 Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:
<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi Kevin,<br>
<br>
Unfortunately the logs are not
correct - are you sure you
properly compiled the mem
debug ? like adding the
QM_DBG_MALLOC and removing the
FM_MALLOC flags ? As the logs
show the standard memory
manager (without debugging).<br>
Check it with "opensips -V" to
see the list of compiled
flags.<br>
<br>
I tried to get some ideas by
only looking at the available
memory and how many fragments
were allocated in each process
- indeed, there are some
processes using maybe like 2
or 3 times more PKG, but not
sure if a leak.<br>
Getting the proper logs (which
will be huge) will tell us
more.
<div><br>
<br>
Regards,<br>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div> On 01.07.2014 18:11,
Kevin Mathy wrote:<br>
</div>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Bogdan,
<div><br>
</div>
<div>
<div>I have now a memdump
log, as we restarted
opensips this afternoon
for a configuration
maintenance... But the
file is too big, even if
I try to put it to <a href="http://pastebin.com" target="_blank">pastebin.com</a> ... So, here
is the file; I don't
want to give the link on
the mailing-list :-) </div>
</div>
</div>
</blockquote>
<br>
[removed]<br>
<br>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div>I hope this will
help understanding our
problem's cause :-)
...</div>
<div><br>
</div>
<div>Thanks for your
help, </div>
<div><br>
</div>
<div>Kevin</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin MATHY</b>
|<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-30
16:30 GMT+02:00 Kevin
Mathy <span dir="ltr"><<a href="mailto:k.mathy@hexanet.fr" target="_blank">k.mathy@hexanet.fr</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div dir="ltr">Hi
Bogdan,
<div><br>
</div>
<div>Ooops, I
thought my two
first mails have
been cancelled
:-)</div>
<div>I prefer
waiting till
there's no
traffic, so I'll
send a SIGUSR1
comme this
evening, and
reply to this
topic with the
log.</div>
<div><br>
</div>
<div>I'll try
working with MI
statistics to
make some memory
usage graphs
better than with
Cacti... </div>
<div><br>
</div>
<div>I'll come
back to you with
logs; thanks for
all !</div>
<div><br>
</div>
<div> Kevin</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra">
<div><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin
MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
</div>
<div class="gmail_quote">2014-06-30
11:54 GMT+02:00
Bogdan-Andrei
Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:
<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi
Kevin,<br>
<br>
There is no
need to send
your email
three times
;). One time
is enough.<br>
<br>
Waiting and
taking the
dump when
there is not
traffic is
good (but not
a must) - the
idea is to be
sure that all
temporary
memory (used
for processing
the current
traffic) was
freed - so
what you still
have in memory
is
configuration
data or
possible
leaks.<br>
If you do not
have the
luxury of
waiting, you
can do it
whenever you
can.<br>
<br>
Once again, do
not look at
the memory
usage reported
by OS - it is
irrelevant as
OpenSIPS is
doing its own
internal
memory
management.<br>
<br>
Check the
memory usage
via MI, see
the mem
related
statistics:<br>
<a href="http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11" target="_blank">http://www.opensips.org/Documentation/Interface-CoreStatistics-1-11</a><br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On
30.06.2014
12:01, Kevin
Mathy wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div style="font-family:arial,sans-serif;font-size:13px">Hi
Bogdan,
<div><br>
</div>
<div>If I want
to send a
SIGUSR1, may I
have to wait
20 minutes
after the last
call ? 20
minutes
without any
call ? I don't
understand
well this
sentence :</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<span>It
is highly
recommended to
do this after
waiting about
20 minutes to
be sure that
as much as
possile memory
is freed - all
temporary
memory used
during
processing is
freed by lack
of load on the
proxy</span></blockquote>
<div><br>
</div>
<div>Also,
last week-end,
the traffic
reduced a lot,
and between
last friday,
when the free
system's
memory was
around 170M,
and this
morning, the
free memory
seems to have
increased :
this morning,
it was around
700M, before
the traffic
comes back.</div>
<div><br>
</div>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">So,
opensips seems
to well free
the memory,
isn't it ? </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">
Thanks for
your help, </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px">Kevin</div>
<div><br>
</div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"> </div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin
MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-27
10:38
GMT+02:00
Bogdan-Andrei
Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Hi
Kevin,<br>
<br>
There is no
need to wait
for a crash.
From time to
time, you can
send a SIGUSR1
to a worker
process (or a
process you
suspect as
running out of
pkg mem) ->
the process
will do a pkg
dump to the
log.<br>
<br>
Also, I would
strongly
advice
upgrading to
1.11 (latest
LTS) - 1.9 is
no longer
maintained and
there were
some fixes in
the memory
manager since
then.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
<div>
<div> On <a href="tel:27.06.2014%2010" value="+12706201410" target="_blank">27.06.2014
10</a>:36,
Kevin Mathy
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div dir="ltr">Hi
Bogdan,
<div><br>
</div>
<div>I've set
given options,
and now I'm
waiting for a
new crash of
the service...
Where the
memdump will
be located ?
In another
logfile than
opensips.log,
or in the same
? </div>
<div><br>
</div>
<div>Thanks </div>
</div>
<div class="gmail_extra"><br clear="all">
<div><b>
<div><span style="font-weight:normal">Bien
cordialement, </span></div>
<div><span style="font-weight:normal">Best
Regards, </span></div>
<div><span style="font-weight:normal"><br>
</span></div>
</b><b>Kevin
MATHY</b> |<b> </b>Ingénieur
VoIP<br>
<div>
<div><b><br>
</b></div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">2014-06-26
18:32
GMT+02:00
Bogdan-Andrei
Iancu <span dir="ltr"><<a href="mailto:bogdan@opensips.org" target="_blank">bogdan@opensips.org</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div><tt>Kevin,<br>
<br>
Restarting
should not
make you loose
ongoing calls
(even if you
use the dialog
module), do do
not worry on
that.<br>
<br>
Regards,<br>
</tt>
<div>
<pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
</div>
</div>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</div>
</div>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</div>
</div>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
</div></div><img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif"></blockquote>
<br>
</div>
</blockquote></div><br></div></div>
<br>
<img src="http://www.hexanet.fr/sites/files/hexanet/files/utilities/signature_hexanet.gif">