[OpenSIPS-Users] CRITICAL:core:receive_fd Error

Bogdan-Andrei Iancu bogdan at voice-system.ro
Fri Jan 16 11:36:09 CET 2009


Hi Antonio,

Was this crash related to the SEAS bug you discovered? or should we 
further investigate?

Thanks and regards,
Bogdan

Antonio Frongillo wrote:
>
>
>     Hi,
>     below the output you requested:
>
>     (gdb) bt
>     #0  0x00da8031 in run_trans_callbacks (type=2048,
>     trans=0xb6082b50, req=0x0, rpl=0x0, code=0) at t_hooks.c:204
>     #1  0x00d951cd in free_cell (dead_cell=0xb6082b50) at h_table.c:124
>     #2  0x00daa574 in delete_cell (p_cell=0xb6082b50, unlock=1) at
>     timer.c:239
>     #3  0x00dab589 in timer_routine (ticks=192, attr=0x0) at timer.c:409
>
>     #4  0x080c5231 in start_timer_processes () at timer.c:280
>     #5  0x0806b703 in main (argc=6, argv=0xbfecb0c4) at main.c:820
>     (gdb) p cbp
>     $1 = (struct tm_callback *) 0x69732f39
>
>     What could be? thanks in advance,
>     Antonio
>
>
>     2009/1/13 Bogdan-Andrei Iancu <bogdan at voice-system.ro
>     <mailto:bogdan at voice-system.ro>>
>
>         Thanks Antonio,
>
>         in gdb, try to print cbp pointer - use "p cbp"....What is the
>         value?
>
>
>         Regards,
>         Bogdan
>
>         Antonio Frongillo wrote:
>
>
>
>             2009/1/12 Antonio Frongillo <antonio at frogweb.it
>             <mailto:antonio at frogweb.it> <mailto:antonio at frogweb.it
>             <mailto:antonio at frogweb.it>>>
>
>
>                Thanks for your reply, I applied the patch you sent.
>                Now it generates a single core file, following it's the
>             bt from
>                gdb, any ideas on what could be?
>
>
>                Thanks in advance,
>                Antonio
>
>                GNU gdb Red Hat Linux (6.3.0.0-1.143.el4rh)
>                Copyright 2004 Free Software Foundation, Inc.
>                GDB is free software, covered by the GNU General Public
>             License,
>                and you are
>                welcome to change it and/or distribute copies of it
>             under certain
>                conditions.
>                Type "show copying" to see the conditions.
>                There is absolutely no warranty for GDB.  Type "show
>             warranty" for
>                details.
>                This GDB was configured as
>             "i386-redhat-linux-gnu"...Using host
>                libthread_db library "/lib/tls/libthread_db.so.1".
>
>                Core was generated by `./opensips -d -d -d -d -E'.
>
>                Program terminated with signal 11, Segmentation fault.
>                Reading symbols from /lib/libdl.so.2...done.
>                Loaded symbols for /lib/libdl.so.2
>                Reading symbols from /lib/libresolv.so.2...done.
>                Loaded symbols for /lib/libresolv.so.2
>                Reading symbols from /lib/libssl.so.4...done.
>                Loaded symbols for /lib/libssl.so.4
>                Reading symbols from /lib/libcrypto.so.4...done.
>                Loaded symbols for /lib/libcrypto.so.4
>                Reading symbols from /lib/tls/libc.so.6...done.
>                Loaded symbols for /lib/tls/libc.so.6
>                Reading symbols from /lib/ld-linux.so.2...done.
>                Loaded symbols for /lib/ld-linux.so.2
>                Reading symbols from /usr/lib/libgssapi_krb5.so.2...done.
>                Loaded symbols for /usr/lib/libgssapi_krb5.so.2
>                Reading symbols from /usr/lib/libkrb5.so.3...done.
>                Loaded symbols for /usr/lib/libkrb5.so.3
>                Reading symbols from /lib/libcom_err.so.2...done.
>                Loaded symbols for /lib/libcom_err.so.2
>                Reading symbols from /usr/lib/libk5crypto.so.3...done.
>                Loaded symbols for /usr/lib/libk5crypto.so.3
>                Reading symbols from /usr/lib/libz.so.1...done.
>                Loaded symbols for /usr/lib/libz.so.1
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/db_mysql.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/db_mysql.so
>                Reading symbols from
>             /usr/lib/mysql/libmysqlclient.so.14...done.
>                Loaded symbols for /usr/lib/mysql/libmysqlclient.so.14
>                Reading symbols from /lib/libcrypt.so.1...done.
>                Loaded symbols for /lib/libcrypt.so.1
>                Reading symbols from /lib/libnsl.so.1...done.
>                Loaded symbols for /lib/libnsl.so.1
>                Reading symbols from /lib/tls/libm.so.6...done.
>                Loaded symbols for /lib/tls/libm.so.6
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/sl.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/sl.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/tm.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/tm.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/rr.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/rr.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/maxfwd.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/maxfwd.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/usrloc.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/usrloc.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/registrar.so...done.
>                Loaded symbols for
>                /product/opensips//lib/opensips/modules/registrar.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/textops.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/textops.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/mi_fifo.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/mi_fifo.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/uri_db.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/uri_db.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/uri.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/uri.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/xlog.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/xlog.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/acc.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/acc.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/seas.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/seas.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/auth.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/auth.so
>                Reading symbols from
>                /product/opensips/lib/opensips/modules/auth_db.so...done.
>                Loaded symbols for
>             /product/opensips//lib/opensips/modules/auth_db.so
>                Reading symbols from /lib/libnss_files.so.2...done.
>                Loaded symbols for /lib/libnss_files.so.2
>                #0  0x00f6c031 in run_trans_callbacks (type=2048,
>                trans=0xb6143358, req=0x0,
>                    rpl=0x0, code=0) at t_hooks.c:204
>                204                     if ( (cbp->types)&type ) {
>                (gdb) bt
>                #0  0x00f6c031 in run_trans_callbacks (type=2048,
>                trans=0xb6143358, req=0x0,
>                    rpl=0x0, code=0) at t_hooks.c:204
>                #1  0x00f591cd in free_cell (dead_cell=0xb6143358) at
>             h_table.c:124
>                #2  0x00f6e574 in delete_cell (p_cell=0xb6143358,
>             unlock=1) at
>                timer.c:239
>                #3  0x00f6f589 in timer_routine (ticks=71, attr=0x0) at
>             timer.c:409
>                #4  0x080c5231 in start_timer_processes () at timer.c:280
>                #5  0x0806b703 in main (argc=6, argv=0xbfe4b414) at
>             main.c:820
>
>
>                2009/1/12 Bogdan-Andrei Iancu <bogdan at voice-system.ro
>             <mailto:bogdan at voice-system.ro>
>                <mailto:bogdan at voice-system.ro
>             <mailto:bogdan at voice-system.ro>>>
>
>                    Hi Antonio,
>
>                    This looks like a double coredump -  please apply
>             the attached
>                    patch and try again; this is not a fix, but a small
>             workaround
>                    to avoid double core dump - please send me again
>             the backtrace
>                    when you get a new crash.
>
>
>                    Regards,
>                    Bogdan
>
>                    Antonio Frongillo wrote:
>
>                        Hi Bogdan,
>                        here it is the backtrace from the core dump.
>
>                        Do you have any idea of what is the cause of
>             this problem???
>
>                        Thanks in advance,
>                        Antonio
>
>                        GNU gdb Red Hat Linux (6.3.0.0-1.143.el4rh)
>                        Copyright 2004 Free Software Foundation, Inc.
>                        GDB is free software, covered by the GNU
>             General Public
>                        License, and you are
>                        welcome to change it and/or distribute copies
>             of it under
>                        certain conditions.
>                        Type "show copying" to see the conditions.
>                        There is absolutely no warranty for GDB.  Type
>             "show
>                        warranty" for details.
>                        This GDB was configured as
>             "i386-redhat-linux-gnu"...Using
>                        host libthread_db library
>             "/lib/tls/libthread_db.so.1".
>
>                        Core was generated by
>             `/product/opensips/sbin/opensips -P
>                        /var/run/opensips.pid'.
>                        Program terminated with signal 11, Segmentation
>             fault.
>                        Reading symbols from /lib/libdl.so.2...done.
>                        Loaded symbols for /lib/libdl.so.2
>                        Reading symbols from /lib/libresolv.so.2...done.
>                        Loaded symbols for /lib/libresolv.so.2
>                        Reading symbols from /lib/libssl.so.4...done.
>                        Loaded symbols for /lib/libssl.so.4
>                        Reading symbols from /lib/libcrypto.so.4...done.
>                        Loaded symbols for /lib/libcrypto.so.4
>                        Reading symbols from /lib/tls/libc.so.6...done.
>                        Loaded symbols for /lib/tls/libc.so.6
>                        Reading symbols from /lib/ld-linux.so.2...done.
>                        Loaded symbols for /lib/ld-linux.so.2
>                        Reading symbols from
>             /usr/lib/libgssapi_krb5.so.2...done.
>                        Loaded symbols for /usr/lib/libgssapi_krb5.so.2
>                        Reading symbols from /usr/lib/libkrb5.so.3...done.
>                        Loaded symbols for /usr/lib/libkrb5.so.3
>                        Reading symbols from /lib/libcom_err.so.2...done.
>                        Loaded symbols for /lib/libcom_err.so.2
>                        Reading symbols from
>             /usr/lib/libk5crypto.so.3...done.
>                        Loaded symbols for /usr/lib/libk5crypto.so.3
>                        Reading symbols from /usr/lib/libz.so.1...done.
>                        Loaded symbols for /usr/lib/libz.so.1
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/db_mysql.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/db_mysql.so
>                        Reading symbols from
>                        /usr/lib/mysql/libmysqlclient.so.14...done.
>                        Loaded symbols for
>             /usr/lib/mysql/libmysqlclient.so.14
>                        Reading symbols from /lib/libcrypt.so.1...done.
>                        Loaded symbols for /lib/libcrypt.so.1
>                        Reading symbols from /lib/libnsl.so.1...done.
>                        Loaded symbols for /lib/libnsl.so.1
>                        Reading symbols from /lib/tls/libm.so.6...done.
>                        Loaded symbols for /lib/tls/libm.so.6
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/sl.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/sl.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/tm.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/tm.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/rr.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/rr.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/maxfwd.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/maxfwd.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/usrloc.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/usrloc.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/registrar.so...done.
>                        Loaded symbols for
>                      
>              /product/opensips//lib/opensips/modules/registrar.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/textops.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/textops.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/mi_fifo.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/mi_fifo.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/uri_db.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/uri_db.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/uri.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/uri.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/xlog.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/xlog.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/acc.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/acc.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/seas.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/seas.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/auth.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/auth.so
>                        Reading symbols from
>                      
>              /product/opensips/lib/opensips/modules/auth_db.so...done.
>                        Loaded symbols for
>                        /product/opensips//lib/opensips/modules/auth_db.so
>                        Reading symbols from /lib/libnss_files.so.2...done.
>                        Loaded symbols for /lib/libnss_files.so.2
>                        #0  0x080d509e in fm_status (qm=0xb5fa9000) at
>                        mem/f_malloc.c:512
>                        512                     for
>             (f=qm->free_hash[h].first,j=0; f;
>                        (gdb) bt
>                        #0  0x080d509e in fm_status (qm=0xb5fa9000) at
>                        mem/f_malloc.c:512
>                        #1  0x08067048 in cleanup (show_status=1) at
>             main.c:356
>                        #2  0x08067a48 in handle_sigs () at main.c:523
>                        #3  0x0806bb9e in main (argc=3,
>             argv=0xbffa9704) at main.c:865
>
>
>                        2009/1/9 Bogdan-Andrei Iancu
>             <bogdan at voice-system.ro <mailto:bogdan at voice-system.ro>
>                        <mailto:bogdan at voice-system.ro
>             <mailto:bogdan at voice-system.ro>>
>                        <mailto:bogdan at voice-system.ro
>             <mailto:bogdan at voice-system.ro>
>                        <mailto:bogdan at voice-system.ro
>             <mailto:bogdan at voice-system.ro>>>>
>
>
>                           Hello Antonio,
>
>                           See:
>
>
>                           Feb 14 16:33:23 asterisk
>                        /product/opensips/sbin/opensips[20330]:
>                           INFO:core:handle_sigs: child process 20356
>             exited by a
>                        signal 11
>                            Feb 14 16:33:23 asterisk
>                        /product/opensips/sbin/opensips[20330]:
>                           INFO:core:handle_sigs: core was generated
>
>                           More or less, you opensips crashes with a
>             Segmentation
>                        Fault (sig
>                           11). The core was generated, so, could you
>             post the
>                        backtrace ?
>
>                           Thanks and regards,
>                           Bogdan
>
>                           Antonio Frongillo wrote:
>
>                               Hi, I'm integrating Opensips 1.4.3-tls
>             (integrated
>                        with WeSip
>                               to use Java Sip Servlet) with Microsoft
>             OCS 2007.
>                        When I
>                               receive a NOTIFY from OCS or sometimes a
>             200 OK
>                        with an XML
>                               Payload I experience an error that makes
>             OpenSips
>                        and my SIP
>                               Servlet stop to work.  I found on
>             internet someone
>                        that seems
>                               to have a similar problem (but use a
>             different
>                        version of
>                               OpenSips), here is the link to the
>             discussion:
>                               devel at lists.opensips.org/msg00007.html
>             <http://devel@lists.opensips.org/msg00007.html>
>                        <http://devel@lists.opensips.org/msg00007.html
>             <http://lists.opensips.org/msg00007.html>>
>                              
>             <http://devel@lists.opensips.org/msg00007.html
>             <http://lists.opensips.org/msg00007.html>
>                        <http://lists.opensips.org/msg00007.html>>
>
>
>                               <http://www.mail-archive.com/%3Ca%20href=>"
>                                        
>             target="_blank">http://www.mail-archive.com/devel@lists.opensips.org/msg00007.html
>                               <mailto:devel at lists.opensips.org
>             <mailto:devel at lists.opensips.org>
>                        <mailto:devel at lists.opensips.org
>             <mailto:devel at lists.opensips.org>>
>                               <mailto:devel at lists.opensips.org
>             <mailto:devel at lists.opensips.org>
>                        <mailto:devel at lists.opensips.org
>             <mailto:devel at lists.opensips.org>>>/msg00007.html>  Below you
>                               can find the OpenSips log:  Feb 14
>             16:27:33 asterisk
>                               /product/opensips/sbin/opensips[20345]:
>                               NOTICE:presence:child_init: init_child
>             [4] pid
>                        [20345]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20356]:
>                               NOTICE:presence:child_init: init_child
>             [5] pid
>                        [20356]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20347]:
>                               NOTICE:presence:child_init: init_child
>             [-1] pid
>                        [20347]  Feb
>                               14 16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20343]:
>                               NOTICE:presence:child_init: init_child
>             [3] pid
>                        [20343]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20358]:
>                               NOTICE:presence:child_init: init_child
>             [6] pid
>                        [20358]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20359]:
>                               NOTICE:presence:child_init: init_child
>             [7] pid
>                        [20359]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20362]:
>                               NOTICE:presence:child_init: init_child
>             [8] pid
>                        [20362]  Feb 14
>                               16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20367]:
>                               NOTICE:presence:child_init: init_child
>             [-4] pid
>                        [20367]  Feb
>                               14 16:27:33 asterisk
>                        /product/opensips/sbin/opensips[20330]:
>                               NOTICE:presence:child_init: init_child
>             [0] pid
>                        [20330]  Feb 14
>                               16:30:59 asterisk
>                        /product/opensips/sbin/opensips[20340]:
>                               INFO:seas:dispatcher_main_loop: polling [2
>                        ServSock] [1 pipe]
>                               [1 App Servers] [0 Uncomplete AS]  Feb
>             14 16:31:34
>                        asterisk
>                               last message repeated 4 times Feb 14
>             16:33:05
>                        asterisk last
>                               message repeated 12 times Feb 14
>             16:33:22 asterisk last
>                               message repeated 4 times Feb 14 16:33:23
>             asterisk
>                               /product/opensips/sbin/opensips[20367]:
>                               CRITICAL:core:receive_fd: EOF on 18  Feb 14
>                        16:33:23 asterisk
>                               /product/opensips/sbin/opensips[20330]:
>                        INFO:core:handle_sigs:
>                               child process 20356 exited by a signal
>             11  Feb 14
>                        16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20330]:
>                               INFO:core:handle_sigs: core was
>             generated  Feb 14
>                        16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20330]:
>                               INFO:core:handle_sigs: terminating due
>             to SIGCHLD
>                         Feb 14
>                               16:33:23 asterisk
>                        /product/opensips/sbin/opensips[20367]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20347]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20362]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20359]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20358]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20354]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20346]:
>                               INFO:seas:seas_sighandler: INFO: signal
>             15 received
>                         Feb 14
>                               16:33:23 asterisk
>                        /product/opensips/sbin/opensips[20345]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20343]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20341]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20338]:
>                               INFO:core:sig_usr: signal 15 received
>              Feb 14 16:33:23
>                               asterisk
>             /product/opensips/sbin/opensips[20340]:
>                               INFO:seas:seas_sighandler: INFO: signal
>             15 received
>                         Feb 14
>                               16:33:26 asterisk
>                        /product/opensips/sbin/opensips[20346]:
>                               INFO:seas:seas_sighandler: [shootist]
>             Action dispatcher
>                               exiting  Feb 14 16:33:26 asterisk
>                               /product/opensips/sbin/opensips[20330]:
>                               NOTICE:presence:destroy: destroy module ...
>                                          
>              ------------------------------------------------------------------------
>
>                              
>             _______________________________________________
>                               Users mailing list
>                               Users at lists.opensips.org
>             <mailto:Users at lists.opensips.org>
>                        <mailto:Users at lists.opensips.org
>             <mailto:Users at lists.opensips.org>>
>                        <mailto:Users at lists.opensips.org
>             <mailto:Users at lists.opensips.org>
>                        <mailto:Users at lists.opensips.org
>             <mailto:Users at lists.opensips.org>>>
>
>                                        
>             http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>                              
>
>
>
>
>             ------------------------------------------------------------------------
>
>             _______________________________________________
>             Users mailing list
>             Users at lists.opensips.org <mailto:Users at lists.opensips.org>
>             http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>              
>
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>   




More information about the Users mailing list