[OpenSIPS-Users] Opensips crashing due to out of memory error

[Anca Vamanu]

Hi John,

That looks very bad...
Please help me investigate this.

What you can do is to compile with memory debugging support - in 
Makefile.defs search -DDBG_QM_MALLOC line, uncomment it, move it above 
-DF_MALLOC line and comment this line with -DF_MALLOC. Then recompile 
and reinstall all. Also set mem_dump=1 in your config.

After a couple of hours, when you see that the memory is high - you can 
either shutdown opensips or ask it to dump the memory by calling 'kill 
-SIGUSR1 lowest_pid' , where lowest_pid is the smallest pid when doing 
'ps aux | grep opensips'. It will dump lots of info in the log file(this 
why is better to do this quite soon - maybe after 1-2 hours in the 
rhythm the memory increases for you). In the logs you will see all the 
chunks of memory and where they were allocated. Look from the end if 
there is a function repeated  many times. You can also send the part of 
the log with the dump to me ( not on the list, because it will be quite 
large).

Thanks and regards,

-- 
Anca Vamanu
OpenSIPS Developer



On 04/19/2011 10:30 AM, John Khvatov wrote:
> Hello Anca,
>
> Sorry, the memory leak is still here:
>
> http://dev.sgu.ru/pub/opensips_memory_usage.2.png
>
> BTW, dialog module was not used in my script. I've removed loadmodule before update.
>
>
> On 12.04.2011, at 0:00, John Khvatov wrote:
>
>> Hello Anca,
>>
>> Thank you for  the advice. I built OpenSIPS from rev7863.  BTW, rev7824 was used in production.
>>
>> I'll let you know the result within a few days.
>>
>>
>> On 11.04.2011, at 17:48, Anca Vamanu wrote:
>>
>>> Hi John,
>>>
>>> Can you please take the pua and pua_usrloc and dialog modules from svn? There were some problems discovered in there and fixed.
>>> The svn version of these modules ( 1.6 branch) is stable, we are using it in production.
>>>
>>> Regards,
>>> -- 
>>> Anca Vamanu
>>> OpenSIPS Developer
>>>
>>>
>>>
>>> On 04/11/2011 12:45 AM, John Khvatov wrote:
>>>> On 10.04.2011, at 8:35, Ronald Cepres wrote:
>>>>
>>>>> Have you tried increasing the amount of allocated memory for OpenSIPS?
>>>> I have same problem with OpenSIPS since 1.6.0 release. OpenSIPS has huge memory leak somewhere. Increasing the amount of allocated memory helps only delay crash.
>>>>
>>>> Memory usage graph (1.6.4, KkB is MB):
>>>> http://dev.sgu.ru/pub/opensips_memory_usage.png
>>>>
>>>> I use the following modules:
>>>>
>>>> $ grep loadmodule opensips.cfg
>>>> loadmodule "signaling.so"
>>>> loadmodule "sl.so"
>>>> loadmodule "tm.so"
>>>> loadmodule "maxfwd.so"
>>>> loadmodule "rr.so"
>>>> loadmodule "textops.so"
>>>> loadmodule "localcache.so"
>>>> loadmodule "mi_fifo.so"
>>>> loadmodule "mi_datagram.so"
>>>> loadmodule "db_flatstore.so"
>>>> loadmodule "siptrace.so"
>>>> loadmodule "db_text.so"
>>>> loadmodule "db_postgres.so"
>>>> loadmodule "db_http.so"
>>>> loadmodule "usrloc.so"
>>>> loadmodule "registrar.so"
>>>> loadmodule "auth.so"
>>>> loadmodule "auth_db.so"
>>>> loadmodule "uri.so"
>>>> loadmodule "domain.so"
>>>> loadmodule "dialog.so"
>>>> loadmodule "mediaproxy.so"
>>>> loadmodule "nat_traversal.so"
>>>> loadmodule "permissions.so"
>>>> loadmodule "alias_db.so"
>>>> loadmodule "avpops.so"
>>>> loadmodule "mi_xmlrpc.so"
>>>> loadmodule "dialplan.so"
>>>> loadmodule "pike.so"
>>>> loadmodule "pua.so"
>>>> loadmodule "pua_usrloc.so"
>>>>
>>>> -- 
>>>> WBR, John Khvatov
>> -- 
>> WBR, John Khvatov