[OpenSIPS-Users] opensips 2.3 crash

Bogdan-Andrei Iancu bogdan at opensips.org
Tue May 3 19:11:53 CEST 2016


Hi Tito,

You should have reported it sooner:)
Could you compile in the memory debugger (as the backtrace you posted 
here points to a memory corruption). Use DBG_MALLOC flag in combination 
with F_ / HP_ / QM_ memeory managers :
     http://www.opensips.org/Documentation/TroubleShooting-OutOfMem

Regards,

Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
http://www.opensips-solutions.com

On 03.05.2016 20:00, Tito Cumpen wrote:
> Group,
>
>
> I get about two nightly crashes in the latest opensips head this has 
> been happening consistently for about a week and half now. All crashes 
> are identical to:
>
> Using host libthread_db library "/lib64/libthread_db.so.1".
>
> Core was generated by `/sbin/opensips -P /var/run/opensips.pid -u 
> opensips -g opensips -M 1024 -f /etc'.
>
> Program terminated with signal 11, Segmentation fault.
>
> #0  0x0000000000512512 in fm_remove_free (n=0x7f384a06b680, 
> qm=0x7f3849fc8010) at mem/f_malloc.c:187
>
> 187*pf=n->u.nxt_free;
>
> Missing separate debuginfos, use: debuginfo-install 
> cyrus-sasl-lib-2.1.26-20.el7_2.x86_64 glibc-2.17-106.el7_2.4.x86_64 
> gmp-6.0.0-12.el7_1.x86_64 gnutls-3.3.8-14.el7_2.x86_64 
> keyutils-libs-1.5.8-3.el7.x86_64 krb5-libs-1.13.2-12.el7_2.x86_64 
> libcom_err-1.42.9-7.el7.x86_64 libcurl-7.29.0-25.el7.centos.x86_64 
> libffi-3.0.13-16.el7.x86_64 libgcc-4.8.5-4.el7.x86_64 
> libgcrypt-1.5.3-12.el7_1.1.x86_64 libgpg-error-1.12-3.el7.x86_64 
> libidn-1.28-4.el7.x86_64 libmicrohttpd-0.9.33-2.el7.x86_64 
> librabbitmq-0.5.2-1.el7.x86_64 libselinux-2.2.2-6.el7.x86_64 
> libssh2-1.4.3-10.el7_2.1.x86_64 libstdc++-4.8.5-4.el7.x86_64 
> libtasn1-3.8-2.el7.x86_64 nettle-2.7.1-4.el7.x86_64 
> nspr-4.11.0-1.el7_2.x86_64 nss-3.21.0-9.el7_2.x86_64 
> nss-softokn-freebl-3.16.2.3-14.2.el7_2.x86_64 
> nss-util-3.21.0-2.2.el7_2.x86_64 openldap-2.4.40-9.el7_2.x86_64 
> openssl-libs-1.0.1e-51.el7_2.4.x86_64 p11-kit-0.20.7-3.el7.x86_64 
> pcre-8.32-15.el7.x86_64 trousers-0.3.13-1.el7.x86_64 
> xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-15.el7.x86_64
>
> (gdb) bt full
>
> #0  0x0000000000512512 in fm_remove_free (n=0x7f384a06b680, 
> qm=0x7f3849fc8010) at mem/f_malloc.c:187
>
>         pf = 0x0
>
>         hash = 2051
>
> #1  fm_malloc (qm=0x7f3849fc8010, size=size at entry=65592) at 
> mem/f_malloc.c:415
>
>         frag = 0x7f384a06b680
>
>         n = <optimized out>
>
>         hash = 2051
>
>         __FUNCTION__ = "fm_malloc"
>
> #2  0x00007f383e018652 in tcp_handle_req (_max_msg_chunks=<optimized 
> out>, con=<optimized out>, req=<optimized out>) at 
> ../../net/proto_tcp/tcp_common.h:459
>
>         local_rcv = {src_ip = {af = 760673648, len = 32766, u = {addrl 
> = {16, 20}, addr32 = {16, 0, 20, 0}, addr16 = {16, 0, 0, 0, 20, 0, 0, 
> 0}, addr = 
> "\020\000\000\000\000\000\000\000\024\000\000\000\000\000\000"}}, 
> dst_ip = {af = 1, len = 1, u = {addrl = {
>
>                 139878494896234, 5869476}, addr32 = {106, 32568, 
> 5869476, 0}, addr16 = {106, 0, 32568, 0, 36772, 89, 0, 0}, addr = 
> "j\000\000\000\070\177\000\000\244\217Y\000\000\000\000"}}, src_port = 
> 0, dst_port = 0, proto = 0, proto_reserved1 = 0,
>
>           proto_reserved2 = 0, src_su = {s = {sa_family = 62576, 
> sa_data = "V-\376\177\000\000\001\000\000\000\000\000\000"}, sin = 
> {sin_family = 62576, sin_port = 11606, sin_addr = {s_addr = 32766}, 
> sin_zero = "\001\000\000\000\000\000\000"}, sin6 = {
>
>               sin6_family = 62576, sin6_port = 11606, sin6_flowinfo = 
> 32766, sin6_addr = {__in6_u = {__u6_addr8 = 
> "\001\000\000\000\000\000\000\000\200\364V-\376\177\000", __u6_addr16 
> = {1, 0, 0, 0, 62592, 11606, 32766, 0}, __u6_addr32 = {1, 0, 
> 760673408, 32766}}},
>
>               sin6_scope_id = 24}}, bind_address = 0x4a03e63000000001}
>
>         msg_buf = <optimized out>
>
>         msg_len = <optimized out>
>
>         c = <optimized out>
>
>         size = <optimized out>
>
> #3  tls_read_req (con=0x7f38481398c0, bytes_read=0x7ffe2d56f550) at 
> proto_tls.c:441
>
>         bytes = <optimized out>
>
>         total_bytes = 0
>
>         req = <optimized out>
>
>         __FUNCTION__ = "tls_read_req"
>
> #4  0x000000000059c478 in handle_io (fm=fm at entry=0x7f384a03e630, 
> idx=idx at entry=3, event_type=event_type at entry=1) at net/net_tcp_proc.c:205
>
>         ret = 0
>
>         n = <optimized out>
>
>         con = 0x7f38481398c0
>
>         s = 106
>
>         rw = <optimized out>
>
>         resp = <optimized out>
>
>         response = {139879704139968, 1}
>
>         __FUNCTION__ = "handle_io"
>
> #5  0x000000000059daee in io_wait_loop_epoll (h=<optimized out>, 
> t=<optimized out>, repeat=<optimized out>) at net/../io_wait_loop.h:221
>
>         ret = <optimized out>
>
>         e = <optimized out>
>
>         n = 1
>
>         r = 4
>
> #6  tcp_worker_proc (unix_sock=<optimized out>) at net/net_tcp_proc.c:312
>
>         __FUNCTION__ = "tcp_worker_proc"
>
> #7  0x00000000005a80c3 in tcp_start_processes 
> (chd_rank=chd_rank at entry=0x841360 <chd_rank.11009>, 
> startup_done=startup_done at entry=0x7f3848136888) at net/net_tcp.c:1758
>
>         r = 2
>
>         reader_fd = {98, 100}
>
>         pid = 0
>
>         load_p = 0x7f38481374e8
>
>         __FUNCTION__ = "tcp_start_processes"
>
> #8  0x0000000000419f05 in main_loop () at main.c:677
>
>         startup_done = 0x7f3848136888
>
>         chd_rank = 15
>
> #9  main (argc=<optimized out>, argv=<optimized out>) at main.c:1258
>
>         cfg_stream = <optimized out>
>
>         c = <optimized out>
>
>         r = <optimized out>
>
>         tmp = 0x7ffe2d56ff65 ""
>
>         tmp_len = <optimized out>
>
>         port = <optimized out>
>
>         proto = <optimized out>
>
>         protos_no = <optimized out>
>
>         options = 0x5daf00 "f:cCm:M:b:l:n:N:rRvdDFETSVhw:t:u:g:P:G:W:o:"
>
>         ret = -1
>
>         seed = 3936233749
>
>         rfd = <optimized out>
>
>         __FUNCTION__ = "main"
>
>
>
> Please advise if anything else is needed.
>
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20160503/4cd42810/attachment-0001.htm>


More information about the Users mailing list