[OpenSIPS-Users] OpenSIPS libmysqlclient.so segfault after MySQL restart

Bogdan-Andrei Iancu bogdan at voice-system.ro
Thu Feb 19 11:18:17 CET 2009 

Hi Om,

I see....in my tests, I get a different error (Lost connection to Mysql 
server)...let me see....

Regards,
Bogdan

Om Bikram Thapa wrote:
> Hi Bogdan,
>
> Just updated to latest svn, but I still see crashes after MySQL
> restart. The syslog shows following 3 lines after MySQL restart and
> registration attempt:
>
> --
> Feb 19 12:17:43 proxy /usr/local/sbin/opensips[2333]:
> ERROR:db_mysql:db_mysql_do_prepared_query: mysql_stmt_execute()
> failed: (1) Unknown prepared statement handler (1) given to
> mysql_stmt_execute
> Feb 19 12:17:43 proxy /usr/local/sbin/opensips[2333]:
> ERROR:auth_db:get_ha1: failed to query database
> Feb 19 12:18:13 proxy kernel: [  105.116919] opensips[2333]: segfault
> at 4c8 ip 7f167c109283 sp 7fff8525b270 error 4 in
> libmysqlclient.so.15.0.0[7f167c0ac000+1bf000]
> --
>
> At first attempt, the registration fails with "SIP/2.0 500 Server
> Internal Error" returned by the server, and subsequent registration
> attempt crashes the server.
>
> gdb backtrace gives following details:
>
> ---
> #0  0x00007f0119426283 in mysql_stmt_result_metadata () from
> /usr/lib/libmysqlclient.so.15
> (gdb) bt
> #0  0x00007f0119426283 in mysql_stmt_result_metadata () from
> /usr/lib/libmysqlclient.so.15
> #1  0x00007f01197d8f82 in db_mysql_do_prepared_query (conn=0x78b278,
> query=<value optimized out>, v=0x7fff22576880, n=<value optimized
> out>, uv=0x0, un=0)
>     at dbase.c:368
> #2  0x00007f01197daccd in db_mysql_query (_h=0x78b278, _k=<value
> optimized out>, _op=<value optimized out>, _v=0x7fff22576880,
> _c=<value optimized out>,
>     _n=1, _nc=2, _o=0x0, _r=0x7fff22576920) at dbase.c:603
> #3  0x00007f0115f56398 in authorize (_m=0x78fe98, _realm=<value
> optimized out>, _table=<value optimized out>, _hftype=<value optimized
> out>)
>     at authorize.c:107
> #4  0x000000000040f869 in do_action (a=0x780a48, msg=0x78fe98) at action.c:961
> #5  0x000000000040e7e5 in run_action_list (a=<value optimized out>,
> msg=0x78fe98) at action.c:139
> #6  0x000000000046f194 in eval_elem (e=0x780b18, msg=0x78fe98,
> val=0x0) at route.c:1189
> #7  0x00000000004708ed in eval_expr (e=0x27648e0, msg=0x78fe98,
> val=0x0) at route.c:1486
> #8  0x000000000047089c in eval_expr (e=0x780b60, msg=0x78fe98,
> val=0x0) at route.c:1502
> #9  0x00000000004708c5 in eval_expr (e=0x780ba8, msg=0x78fe98,
> val=0x0) at route.c:1507
> #10 0x000000000040f91c in do_action (a=0x780f40, msg=0x78fe98) at action.c:688
> #11 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
> msg=0x78fe98) at action.c:139
> #12 0x00000000004114d3 in do_action (a=0x781eb0, msg=0x78fe98) at action.c:705
> #13 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
> msg=0x78fe98) at action.c:139
> #14 0x0000000000410e07 in do_action (a=0x77ee88, msg=0x78fe98) at action.c:119
> #15 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
> msg=0x78fe98) at action.c:139
> #16 0x00000000004114d3 in do_action (a=0x77f028, msg=0x78fe98) at action.c:705
> #17 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
> msg=0x78fe98) at action.c:139
> #18 0x00000000004125fe in run_top_route (a=0x777e78, msg=0x78fe98) at
> action.c:119
> #19 0x000000000045e898 in receive_msg (
>     buf=0x749180 "REGISTER sip:x.x.x.x SIP/2.0\r\nCSeq: 58
> REGISTER\r\nVia: SIP/2.0/UDP
> x.x.x.x:5068;branch=z9hG4bK5ca4685b-befc-dd11-911f-0015c5404858;rport\r\nUser-Agent:
> Ekiga/2.0.12\r\nAuthorization: Dig"..., len=750,
> rcv_info=0x7fff22578090) at receive.c:165
> #20 0x000000000049d3a6 in udp_rcv_loop () at udp_server.c:449
> #21 0x00000000004291fb in main (argc=<value optimized out>,
> argv=0x7fff22578278) at main.c:778
> ---
>
> I have tried several times and each time I get the same sequence of results.
>
> Thanks,
> Om.
>
> On Thu, Feb 19, 2009 at 11:22 AM, Om Bikram Thapa <om.thapa at gmail.com> wrote:
>   
>> Thanks Bogdan. I will update and let you know.
>>
>> Regards,
>> Om.
>>
>> On Thu, Feb 19, 2009 at 2:48 AM, Bogdan-Andrei Iancu
>> <bogdan at voice-system.ro> wrote:
>>     
>>> Hi Om,
>>>
>>> There is a fix available on SVN - please update and see if it works now.
>>>
>>> Thanks and regards,
>>> Bogdan
>>>
>>> Om Bikram Thapa wrote:
>>>       
>>>> Hi Bogdan,
>>>>
>>>> I have submitted the bug on the tracker.
>>>>
>>>> Thanks,
>>>> Om.
>>>>
>>>> On Tue, Feb 17, 2009 at 3:50 AM, Bogdan-Andrei Iancu
>>>> <bogdan at voice-system.ro> wrote:
>>>>
>>>>         
>>>>> Hi Om,
>>>>>
>>>>> Thanks for the report - I may have an idea what is the problem; I will
>>>>> try
>>>>> to reproduce the crash in the following days.
>>>>>
>>>>> Could you please open a bug report on the tracker - just not to forget
>>>>> about
>>>>> it :D (see http://www.opensips.org/index.php?n=Development.Tracker)
>>>>>
>>>>> Regards,
>>>>> Bogdan
>>>>>
>>>>> Om Bikram Thapa wrote:
>>>>>
>>>>>           
>>>>>> Hi,
>>>>>>
>>>>>> OpenSIPS is dying with "libmysqlclient.so Segmentation Fault" after
>>>>>> MySQL server restart. The log shows
>>>>>> "opensips[16769]: segfault at 4c8 ip 7f36728bf283 sp 7fff7ba11a90
>>>>>> error 4 in libmysqlclient.so.15.0.0[7f3672862000+1bf000]"
>>>>>>
>>>>>> and gdb bt shows:
>>>>>>
>>>>>> -------------
>>>>>> #0  0x00007f36728bf283 in mysql_stmt_result_metadata () from
>>>>>> /usr/lib/libmysqlclient.so.15
>>>>>> #1  0x00007f3672c707b7 in db_mysql_do_prepared_query (conn=0x78b278,
>>>>>> query=<value optimized out>, v=0x7fff7ba11d20, n=1, uv=0x0, un=0) at
>>>>>> dbase.c:363
>>>>>> #2  0x00007f3672c72e1f in db_mysql_query (_h=0x78b278, _k=<value
>>>>>> optimized out>, _op=<value optimized out>, _v=0x7fff7ba11d20,
>>>>>> _c=<value optimized out>,
>>>>>>   _n=1, _nc=2, _o=0x0, _r=0x7fff7ba11dc0) at dbase.c:591
>>>>>> #3  0x00007f366f3f0398 in authorize (_m=0x78fe98, _realm=<value
>>>>>> optimized out>, _table=<value optimized out>, _hftype=<value optimized
>>>>>> out>)
>>>>>>   at authorize.c:107
>>>>>> #4  0x000000000040f869 in do_action (a=0x780a48, msg=0x78fe98) at
>>>>>> action.c:961
>>>>>> #5  0x000000000040e7e5 in run_action_list (a=<value optimized out>,
>>>>>> msg=0x78fe98) at action.c:139
>>>>>> #6  0x000000000046f194 in eval_elem (e=0x780b18, msg=0x78fe98,
>>>>>> val=0x0) at route.c:1189
>>>>>> #7  0x00000000004708ed in eval_expr (e=0x120b1e0, msg=0x78fe98,
>>>>>> val=0x0) at route.c:1486
>>>>>> #8  0x000000000047089c in eval_expr (e=0x780b60, msg=0x78fe98,
>>>>>> val=0x0) at route.c:1502
>>>>>> #9  0x00000000004708c5 in eval_expr (e=0x780ba8, msg=0x78fe98,
>>>>>> val=0x0) at route.c:1507
>>>>>> #10 0x000000000040f91c in do_action (a=0x780f40, msg=0x78fe98) at
>>>>>> action.c:688
>>>>>> #11 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
>>>>>> msg=0x78fe98) at action.c:139
>>>>>> #12 0x00000000004114d3 in do_action (a=0x781eb0, msg=0x78fe98) at
>>>>>> action.c:705
>>>>>> #13 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
>>>>>> msg=0x78fe98) at action.c:139
>>>>>> #14 0x0000000000410e07 in do_action (a=0x77ee88, msg=0x78fe98) at
>>>>>> action.c:119
>>>>>> #15 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
>>>>>> msg=0x78fe98) at action.c:139
>>>>>> #16 0x00000000004114d3 in do_action (a=0x77f028, msg=0x78fe98) at
>>>>>> action.c:705
>>>>>> #17 0x000000000040e7e5 in run_action_list (a=<value optimized out>,
>>>>>> msg=0x78fe98) at action.c:139
>>>>>> #18 0x00000000004125fe in run_top_route (a=0x777e78, msg=0x78fe98) at
>>>>>> action.c:119
>>>>>> #19 0x000000000045e898 in receive_msg (
>>>>>>   buf=0x749180 "REGISTER sip:xxxxx SIP/2.0\r\nCSeq: 2
>>>>>> REGISTER\r\nVia: SIP/2.0/UDP
>>>>>>
>>>>>>
>>>>>> x.x.x.x:5061;branch=z9hG4bK60f1b2dd-57fa-dd11-9401-0015c5404858;rport\r\nUser-Agent:
>>>>>> Ekiga/2.0.12\r\nAuthorization: Dige"..., len=749,
>>>>>> rcv_info=0x7fff7ba13530) at receive.c:165
>>>>>> #20 0x000000000049d3a6 in udp_rcv_loop () at udp_server.c:449
>>>>>> #21 0x00000000004291fb in main (argc=<value optimized out>,
>>>>>> argv=0x7fff7ba13718) at main.c:778
>>>>>> ------------
>>>>>>
>>>>>> Server runs fine after restart until MySQL is restarted again. In my
>>>>>> lab setup, OpenSIPS is getting killed triggered by registration
>>>>>> request every morning (probably due to MySQL being restarted daily
>>>>>> with logrotate).
>>>>>>
>>>>>> The server is the latest trunk on Debian lenny/AMD64.
>>>>>>
>>>>>> Thanks,
>>>>>> Om.
>>>>>>
>>>>>> _______________________________________________
>>>>>> Users mailing list
>>>>>> Users at lists.opensips.org
>>>>>> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>>>>>>
>>>>>>
>>>>>>
>>>>>>             
>>>>>           
>>>>         
>>>       
>
>

More information about the Users mailing list