[OpenSIPS-Users] OpenSIPS core dumps

thrillerbee thrillerbee at gmail.com
Fri Nov 5 04:37:46 CET 2010


Bogdan,

I am not seeing any other errors in the logs.  Is there anything else I can
look at?  Both proxies are crashing everyday.

Thanks.

On Wed, Nov 3, 2010 at 4:21 AM, Bogdan-Andrei Iancu
<bogdan at voice-system.ro>wrote:

> I got some clue about what is happening - as you are using flatstore for
> acc, the acc module does not check the success of the "use_table" DB
> operation - in 90% of the cases (for mysql, postgres, etc) this function
> cannot fail, but it seams that for flatstore can. And if it fails, the
> h->tail is set to NULL, leading to crash.
>
> Now, before the crash itself, do you see any other ERROR messages (even
> long before the crash) related to flatstore module ? Try:
>    grep "ERROR" opensips_log_file | grep "flatstore"
>
> Regards,
> Bogdan
>
> thrillerbee wrote:
> > Bogdan,
> >
> > One more detail that may help - I added another OpenSIPS proxy in
> > parallel with this one (& load balancing between the two) and now both
> > OpenSIPS proxies crash at the same time (within a couple seconds).
> >
> > I can provide more core dumps if it will help.
> >
> > Thanks.
> >
> >
> > On Tue, Nov 2, 2010 at 9:02 AM, thrillerbee <thrillerbee at gmail.com
> > <mailto:thrillerbee at gmail.com>> wrote:
> >
> >     Bogdan,
> >
> >     Below is the info requested:
> >     (gdb) frame 0
> >     #0  0x00007f51999f221f in flat_db_insert (h=0x7f0978,
> >     k=0x7f5198732a60, v=0x7f5198732d20, n=19) at flatstore.c:165
> >     165             f = CON_FILE(h);
> >     (gdb) print h
> >     $1 = (const db_con_t *) 0x7f0978
> >     (gdb) print h->tail
> >     $2 = 0
> >     (gdb) print ((struct flat_con*)(h->tail))->file
> >     Cannot access memory at address 0x10
> >
> >     Before each of the crashes yesterday, I saw these in the logs:
> >     Nov  1 14:17:40 core1 kernel: [4287745.452111] opensips[22141]:
> >     segfault at 10 ip 7f51999f221f sp 7fffbcd8d510 error 4 in
> >     db_flatstore.so[7f51999ef000+5000]
> >     Nov  1 23:52:58 core1 kernel: [4348562.990735] opensips[26978]:
> >     segfault at 10 ip 7f726cb9b21f sp 7ffff083f6f0 error 4 in
> >     db_flatstore.so[7f726cb98000+5000]
> >
> >     Are there any compiler flags I should use for debugging?
> >     (gdb) info locals
> >     f = <value optimized out>
> >     i = <value optimized out>
> >     l = <value optimized out>
> >     p = <value optimized out>
> >     __FUNCTION__ = "flat_db_insert"
> >
> >     Thanks again.
> >
> >
> >     On Tue, Nov 2, 2010 at 4:18 AM, Bogdan-Andrei Iancu
> >     <bogdan at voice-system.ro <mailto:bogdan at voice-system.ro>> wrote:
> >
> >         Hi,
> >
> >         in frame 0, could you print:
> >            h
> >            h->tail
> >            ((struct flat_con*)(h->tail))->file
> >
> >         Also, before crash, do you see in the logs any errors from the
> >         db_flatstore module ?
> >
> >         Regards,
> >         Bogdan
> >
> >         thrillerbee wrote:
> >         > Bogdan,
> >         >
> >         > It crashed again tonight.  I've attached the backtrace.
> >         >
> >         > Thanks.
> >         >
> >         > On Mon, Nov 1, 2010 at 9:32 AM, thrillerbee
> >         <thrillerbee at gmail.com <mailto:thrillerbee at gmail.com>
> >         > <mailto:thrillerbee at gmail.com
> >         <mailto:thrillerbee at gmail.com>>> wrote:
> >         >
> >         >     Bogdan,
> >         >
> >         >     Yes,  I've attached 2 to my response - one was a crash
> >         from 10/29.
> >         >      The other occurred a few minutes ago.
> >         >
> >         >     Thanks.
> >         >
> >         >     On Fri, Oct 22, 2010 at 11:41 AM, Bogdan-Andrei Iancu
> >         >     <bogdan at voice-system.ro <mailto:bogdan at voice-system.ro>
> >         <mailto:bogdan at voice-system.ro
> >         <mailto:bogdan at voice-system.ro>>> wrote:
> >         >
> >         >         Any chance with the backtraces ?
> >         >
> >         >         Regards,
> >         >         Bogdan
> >         >
> >         >         Anca Vamanu wrote:
> >         >         > Hi,
> >         >         >
> >         >         > You need to inspect them with gdb, run: gdb
> >         >         > path_to_opensips_executable path_to_corefile, and
> >         then run
> >         >         'bt full'
> >         >         > and send the output.
> >         >         >
> >         >         > Regards,
> >         >         > --
> >         >         > Anca Vamanu
> >         >         > www.voice-system.ro <http://www.voice-system.ro>
> >         <http://www.voice-system.ro>
> >         >         >
> >         >         >
> >         >         > On 10/14/2010 10:12 PM, thrillerbee wrote:
> >         >         >> I have this info from dmesg:
> >         >         >>
> >         >         >> [1985853.285221] opensips[30865]: segfault at 10 ip
> >         >         7f43899ce21f sp
> >         >         >> 7fff8de1cf40 error 4 in
> >         db_flatstore.so[7f43899cb000+5000]
> >         >         >> [1985856.379671] opensips[30858]: segfault at 10 ip
> >         >         7f43899ce21f sp
> >         >         >> 7fff8de1cf40 error 4 in
> >         db_flatstore.so[7f43899cb000+5000]
> >         >         >> [1985896.961279] opensips[30868]: segfault at 10 ip
> >         >         7f43899ce21f sp
> >         >         >> 7fff8de1cf40 error 4 in
> >         db_flatstore.so[7f43899cb000+5000]
> >         >         >>
> >         >         >> [2000131.245512] opensips[17672]: segfault at 10 ip
> >         >         7fd0f21fb21f sp
> >         >         >> 7fff3a3b4f00 error 4 in
> >         db_flatstore.so[7fd0f21f8000+5000]
> >         >         >> [2000161.735962] opensips[17668]: segfault at 10 ip
> >         >         7fd0f21fb21f sp
> >         >         >> 7fff3a3b4e40 error 4 in
> >         db_flatstore.so[7fd0f21f8000+5000]
> >         >         >> [2000167.299402] opensips[17670]: segfault at 10 ip
> >         >         7fd0f21fb21f sp
> >         >         >> 7fff3a3b4f00 error 4 in
> >         db_flatstore.so[7fd0f21f8000+5000]
> >         >         >>
> >         >         >> On Thu, Oct 14, 2010 at 1:57 PM, thrillerbee
> >         >         <thrillerbee at gmail.com
> >         <mailto:thrillerbee at gmail.com> <mailto:thrillerbee at gmail.com
> >         <mailto:thrillerbee at gmail.com>>
> >         >         >> <mailto:thrillerbee at gmail.com
> >         <mailto:thrillerbee at gmail.com>
> >         >         <mailto:thrillerbee at gmail.com
> >         <mailto:thrillerbee at gmail.com>>>> wrote:
> >         >         >>
> >         >         >>     When OpenSIPS crashes, three corefiles are
> >         generated
> >         >         that are
> >         >         >>     2.1GB in size.  How do I use these files to
> >         understand
> >         >         what's
> >         >         >>     causing the crash?
> >         >         >>
> >         >         >>     Thanks.
> >         >         >>
> >         >         >>
> >         >         >
> >         >
> >
> ------------------------------------------------------------------------
> >         >         >
> >         >         > _______________________________________________
> >         >         > Users mailing list
> >         >         > Users at lists.opensips.org
> >         <mailto:Users at lists.opensips.org>
> >         <mailto:Users at lists.opensips.org
> >         <mailto:Users at lists.opensips.org>>
> >         >         >
> >         http://lists.opensips.org/cgi-bin/mailman/listinfo/users
> >         >         >
> >         >
> >         >
> >         >         --
> >         >         Bogdan-Andrei Iancu
> >         >         OpenSIPS Bootcamp
> >         >         15 - 19 November 2010, Edison, New Jersey, USA
> >         >         www.voice-system.ro <http://www.voice-system.ro>
> >         <http://www.voice-system.ro>
> >         >
> >         >
> >         >         _______________________________________________
> >         >         Users mailing list
> >         >         Users at lists.opensips.org
> >         <mailto:Users at lists.opensips.org>
> >         <mailto:Users at lists.opensips.org
> >         <mailto:Users at lists.opensips.org>>
> >         >
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
> >         >
> >         >
> >         >
> >         >
> >
> ------------------------------------------------------------------------
> >         >
> >         > _______________________________________________
> >         > Users mailing list
> >         > Users at lists.opensips.org <mailto:Users at lists.opensips.org>
> >         > http://lists.opensips.org/cgi-bin/mailman/listinfo/users
> >
> >
> >         --
> >         Bogdan-Andrei Iancu
> >         OpenSIPS Bootcamp
> >         15 - 19 November 2010, Edison, New Jersey, USA
> >         www.voice-system.ro <http://www.voice-system.ro>
> >
> >
> >         _______________________________________________
> >         Users mailing list
> >         Users at lists.opensips.org <mailto:Users at lists.opensips.org>
> >         http://lists.opensips.org/cgi-bin/mailman/listinfo/users
> >
> >
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > Users mailing list
> > Users at lists.opensips.org
> > http://lists.opensips.org/cgi-bin/mailman/listinfo/users
> >
>
>
> --
> Bogdan-Andrei Iancu
> OpenSIPS Bootcamp
> 15 - 19 November 2010, Edison, New Jersey, USA
> www.voice-system.ro
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.opensips.org/pipermail/users/attachments/20101104/6902ba24/attachment-0001.htm 


More information about the Users mailing list