[OpenSIPS-Users] ERROR:usrloc:shm_str_dup: no shared memory left

Bogdan-Andrei Iancu bogdan at voice-system.ro
Thu Dec 17 12:29:32 CET 2009 

I see some logs from the kernel about the SEGFAULT, but I see no logs 
from opensips about the SEGFAULT....normally, the attendant process 
should detect the crash of any processes and report it.....

the core file (if generated) should be in the working directory you set 
for opensips (-w options). If none used, check the local dir or the / dir.

Regards,
Bogdan

Josip Djuricic wrote:
> Where should the core be dumped by default?
>
> This is what has been logged (but since debug=0 not much)
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:shm_str_dup: no shared memory left
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:new_ucontact: no more shm memory
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:insert_ucontact: failed to insert contact
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:registrar:insert_contacts: failed to insert contact
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]:
> ERROR:usrloc:new_urecord: no more share memory
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]:
> ERROR:usrloc:mem_insert_urecord: creating urecord failed
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]:
> ERROR:usrloc:insert_urecord: inserting record failed
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]:
> ERROR:registrar:insert_contacts: failed to insert new record structure
> Dec 17 01:24:17 test03 kernel: [135241.226248] opensips[6302]: segfault at 0
> ip 7fc0c897efb1 sp 7fffb9a41fe0 error 6 in usrloc.so[7fc0c8977000+1b000]
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:new_ucontact: no more shm memory
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:insert_ucontact: failed to insert contact
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]:
> ERROR:registrar:insert_contacts: failed to insert contact
> Dec 17 01:24:17 test03 kernel: [135241.381974] opensips[6300]: segfault at 0
> ip 7fc0c897efb1 sp 7fffb9a41fe0 error 6 in usrloc.so[7fc0c8977000+1b000]
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:new_urecord: no more share memory
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:mem_insert_urecord: creating urecord failed
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:insert_urecord: inserting record failed
> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]:
> ERROR:registrar:insert_contacts: failed to insert new record structure
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:new_ucontact: no more shm memory
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6301]:
> ERROR:usrloc:insert_ucontact: failed to insert contact
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6301]:
> ERROR:registrar:insert_contacts: failed to insert contact
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:new_urecord: no more share memory
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:mem_insert_urecord: creating urecord failed
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:insert_urecord: inserting record failed
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:registrar:insert_contacts: failed to insert new record structure
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:new_ucontact: no more shm memory
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:usrloc:insert_ucontact: failed to insert contact
> Dec 17 01:24:18 test03 /usr/local/sbin/opensips[6303]:
> ERROR:registrar:insert_contacts: failed to insert contact
>
> Before and after that nothing is logged.
>
> -----Original Message-----
> From: users-bounces at lists.opensips.org
> [mailto:users-bounces at lists.opensips.org] On Behalf Of Bogdan-Andrei Iancu
> Sent: Thursday, December 17, 2009 11:50 AM
> To: OpenSIPS users mailling list
> Subject: Re: [OpenSIPS-Users] ERROR:usrloc:shm_str_dup: no shared memory
> left
>
> And the crash did generated a coredump ? what were the last logs from 
> opensips before vanishing ?
>
> Regards,
> Bogdan
>
> Josip Djuricic wrote:
>   
>> Hi Bogdan,
>>
>> Unfortunately I forgot to mention that after this error happened this
>>     
> night,
>   
>> opensips was not running anymore, I guess it crashed, but since I've used
>> debug=0 I don't know what last happened before the crash.
>>
>> Thanks,
>>
>> Josip
>>
>>
>> -----Original Message-----
>> From: users-bounces at lists.opensips.org
>> [mailto:users-bounces at lists.opensips.org] On Behalf Of Bogdan-Andrei Iancu
>> Sent: Thursday, December 17, 2009 11:39 AM
>> To: OpenSIPS users mailling list
>> Subject: Re: [OpenSIPS-Users] ERROR:usrloc:shm_str_dup: no shared memory
>> left
>>
>> Hi Josip,
>>
>> have you went through this: http://www.opensips.org/Resources/DocsTsMem
>>
>> First is to see if it a simple memory exhaustion or a mem leak.
>>
>> Regards,
>> Bogdan
>>
>> Josip Djuricic wrote:
>>   
>>     
>>> Hi,
>>>
>>> I'm experiencing strange things with opensips (trunk). I'm testing it 
>>> with sipp to see how it's reacting to 100 000 user registrations.
>>>
>>> For auth I'm using auth_aaa module with radius support, and mysql for 
>>> db_persistency.
>>>
>>> So what I have noticed so far is:
>>>
>>> If I test at rates of 40 registration per second with 100 000 unique 
>>> users (looping 100000 registrations over and over), and expiry time of 
>>> 3600secs, everything works fine, because there is no expired and 
>>> opensips don't have to delete anything from db and memory. Memory is 
>>> constant according to ps, free and top
>>>
>>> But if I use 20min registration expire time, after some time(740841 
>>> registration request sent) I get:
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]: 
>>> ERROR:usrloc:shm_str_dup: no shared memory left
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]: 
>>> ERROR:usrloc:new_ucontact: no more shm memory
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]: 
>>> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]: 
>>> ERROR:usrloc:insert_ucontact: failed to insert contact
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6303]: 
>>> ERROR:registrar:insert_contacts: failed to insert contact
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]: 
>>> ERROR:usrloc:new_urecord: no more share memory
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]: 
>>> ERROR:usrloc:mem_insert_urecord: creating urecord failed
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]: 
>>> ERROR:usrloc:insert_urecord: inserting record failed
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6300]: 
>>> ERROR:registrar:insert_contacts: failed to insert new record structure
>>>
>>> Dec 17 01:24:17 test03 kernel: [135241.226248] opensips[6302]: 
>>> segfault at 0 ip 7fc0c897efb1 sp 7fffb9a41fe0 error 6 in 
>>> usrloc.so[7fc0c8977000+1b000]
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]: 
>>> ERROR:usrloc:new_ucontact: no more shm memory
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]: 
>>> ERROR:usrloc:mem_insert_ucontact: failed to create new contact
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]: 
>>> ERROR:usrloc:insert_ucontact: failed to insert contact
>>>
>>> Dec 17 01:24:17 test03 /usr/local/sbin/opensips[6301]: 
>>> ERROR:registrar:insert_contacts: failed to insert contact
>>>
>>> Dec 17 01:24:17 test03 kernel: [135241.381974] opensips[6300]: 
>>> segfault at 0 ip 7fc0c897efb1 sp 7fffb9a41fe0 error 6 in 
>>> usrloc.so[7fc0c8977000+1b000]
>>>
>>> Since I am just registering same contacts like before I wonder why 
>>> this happen?
>>>
>>> It seams to me that expired contacts doesn't get deleted from memory? 
>>> So SHM is constantly rising? Is there anyway to check if this is the
>>>       
> case?
>   
>>> Also I'm starting opensips with -m 128 and I've changed private memory 
>>> to 16*1024*1024 so that it can read 100000 contacts from db when
>>>       
> starting.
>   
>>> I'm using default configuration for test, just added db and radius 
>>> support.
>>>
>>> Any ideas?
>>>
>>> Perhaps I should move to stable v1.6?
>>>
>>> Thanks,
>>>
>>> Josip
>>>
>>> ------------------------------------------------------------------------
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opensips.org
>>> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>>>   
>>>     
>>>       
>>   
>>     
>
>
>   


-- 
Bogdan-Andrei Iancu
www.voice-system.ro

More information about the Users mailing list