Same thing just happened about 2 hours ago. Can't figure out exactly what scenario caused it, but I do have another core. I also have sip_trace enabled (this is a dev environment) so I can get time stamps / messages if specific (occured at 16:28 UTC, this is more of a reminder for me if I dig this mail back up).<div>
<br></div><div><div>#0 0x00f79402 in __kernel_vsyscall ()</div><div>No symbol table info available.</div><div>#1 0x00651df0 in raise () from /lib/libc.so.6</div><div>No symbol table info available.</div><div>#2 0x00653701 in abort () from /lib/libc.so.6</div>
<div>No symbol table info available.</div><div>#3 0x00c81f80 in t_check (p_msg=0x81a3b5c, param_branch=0xbfea4f78) at t_lookup.c:922</div><div> local_branch = -1472441108</div><div> __FUNCTION__ = "t_check"</div>
<div>#4 0x00c905c1 in reply_received (p_msg=0x81a3b5c) at t_reply.c:1379</div><div> msg_status = 135032812</div><div> last_uac_status = 135829024</div><div> branch = 0</div><div> reply_status = 135945792</div>
<div> timer = 13020730968</div><div> cancel_bitmap = 135032812</div><div> uac = 0xbfea4fb8</div><div> t = 0x7433</div><div> backup_list = 0x625ca0</div><div> has_reply_route = 3219804656</div>
<div> __FUNCTION__ = "reply_received"</div><div>#5 0x080626cc in forward_reply (msg=0x81a3b5c) at forward.c:561</div><div> new_buf = 0x0</div><div> to = 0x0</div><div> new_len = 816</div>
<div> mod = 0x818dfec</div><div> proto = -1075163096</div><div> id = 0</div><div> send_sock = 0x819e230</div><div> s = 0x81a3b5c "\272\026"</div><div> len = -1075163096</div>
<div> __FUNCTION__ = "forward_reply"</div><div>#6 0x0808d401 in receive_msg (</div><div> buf=0x8167da0 "SIP/2.0 200 canceling\r\nVia: SIP/2.0/UDP 69.61.97.121;branch=z9hG4bK892d.dd4f52c.0\r\nFrom: \"SHERWOOD JOHN W\" <sip:+17704038419@4.55.4.163:5060;isup-oli=62>;tag=gK0460d281\r\nCall-ID: 990155349_100542878@4"..., </div>
<div> len=380, rcv_info=0xbfea5098) at receive.c:200</div><div> msg = 0x81a3b5c</div><div> __FUNCTION__ = "receive_msg"</div><div>#7 0x080c3105 in udp_rcv_loop () at udp_server.c:492</div><div>
len = 380</div><div> tmp = 0x15 <Address 0x15 out of bounds></div><div> from = 0x81a3b30</div><div> fromlen = 16</div><div> ri = {src_ip = {af = 2, len = 4, u = {addrl = {2036415813, 3219804656, 3219804376, 0}, addr32 = {2036415813, 3219804656, 3219804376, 0}, addr16 = {15685, 31073, 20976, 49130, 20696, 49130, 0, 0}, </div>
<div> addr = "E=ay\360Q\352\277\330P\352\277\000\000\000"}}, dst_ip = {af = 2, len = 4, u = {addrl = {2036415813, 0, 0, 0}, addr32 = {2036415813, 0, 0, 0}, addr16 = {15685, 31073, 0, 0, 0, 0, 0, 0}, </div>
<div> addr = "E=ay", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = "\023\304E=ay\000\000\000\000\000\000\000"}, </div>
<div> sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 2036415813}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 2036415813, sin6_addr = {in6_u = {</div>
<div> u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x819e8b0}</div><div> p = 0x0</div><div>
buf = "SIP/2.0 200 canceling\r\nVia: SIP/2.0/UDP 69.61.97.121;branch=z9hG4bK892d.dd4f52c.0\r\nFrom: \"SHERWOOD JOHN W\" <sip:+17704038419@4.55.4.163:5060;isup-oli=62>;tag=gK0460d281\r\nCall-ID: 990155349_100542878@4"...</div>
<div> __FUNCTION__ = "udp_rcv_loop"</div><div>#8 0x08066b9a in main_loop () at main.c:818</div><div> i = 2</div><div> pid = 0</div><div> si = 0x819e8b0</div><div> startup_done = 0x0</div>
<div> chd_rank = 11</div><div> __FUNCTION__ = "main_loop"</div><div>#9 0x08068c3b in main (argc=3, argv=0xbfea5274) at main.c:1388</div><div> cfg_log_stderr = 0</div><div> cfg_stream = 0x9882008</div>
<div> c = -1</div><div> r = 0</div><div> tmp = 0xbfea51b8 ""</div><div>---Type <return> to continue, or q <return> to quit---</div><div><br></div><br><div class="gmail_quote">On Wed, Jul 21, 2010 at 3:29 PM, Bobby Smith <span dir="ltr"><<a href="mailto:bobby.smith@gmail.com">bobby.smith@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Ran into a crash on latest opensips_1_6 branch from svn (r 7038). Not exactly sure what happened, it looks like in trying to relay a cancel (which we wouldn't alter). Contents of core are below. Also, modules in use:<div>
<br></div><div><div>loadmodule "db_postgres.so"</div><div>loadmodule "sl.so"</div><div>loadmodule "tm.so"</div><div>loadmodule "rr.so"</div><div>loadmodule "maxfwd.so"</div>
<div>loadmodule "textops.so"</div><div>loadmodule "mi_fifo.so"</div><div>loadmodule "xlog.so"</div><div>loadmodule "nathelper.so"</div><div>loadmodule "uri.so"</div><div>
loadmodule "avpops.so"</div>
<div>loadmodule "signaling.so"</div><div>loadmodule "dialog.so"</div><div>loadmodule "load_balancer.so"</div><div>loadmodule "siptrace.so"</div><div><br></div><div><div>Core was generated by `/usr/local/opensips/sbin/opensips -P /var/run/opensips.pid'.</div>
<div>Program terminated with signal 6, Aborted.</div><div>#0 0x00a17402 in __kernel_vsyscall ()</div><div>(gdb) bt full</div><div>#0 0x00a17402 in __kernel_vsyscall ()</div><div>No symbol table info available.</div><div>
#1 0x00651df0 in raise () from /lib/libc.so.6</div><div>No symbol table info available.</div><div>#2 0x00653701 in abort () from /lib/libc.so.6</div><div>No symbol table info available.</div><div>#3 0x00162f80 in t_check (p_msg=0x81a3ae4, param_branch=0xbf91f768) at t_lookup.c:922</div>
<div> local_branch = -1474669952</div><div> __FUNCTION__ = "t_check"</div><div>#4 0x001715c1 in reply_received (p_msg=0x81a3ae4) at t_reply.c:1379</div><div> msg_status = 135032812</div><div>
last_uac_status = 135829064</div><div> branch = 0</div><div> reply_status = 1</div><div> timer = 4430796376</div><div> cancel_bitmap = 135032812</div><div> uac = 0xbf91f7a8</div>
<div> t = 0x16a6</div><div> backup_list = 0x625ca0</div><div> has_reply_route = 3214014944</div><div> __FUNCTION__ = "reply_received"</div><div>#5 0x080626cc in forward_reply (msg=0x81a3ae4) at forward.c:561</div>
<div> new_buf = 0x0</div><div> to = 0x0</div><div> new_len = 816</div><div> mod = 0x818dfec</div><div> proto = -1080952808</div><div> id = 0</div><div> send_sock = 0x819e1f8</div>
<div> s = 0x81a3ae4 "\034\005"</div><div> len = -1080952808</div><div> __FUNCTION__ = "forward_reply"</div><div>#6 0x0808d401 in receive_msg (</div><div> buf=0x8167da0 "SIP/2.0 200 canceling\r\nVia: SIP/2.0/UDP 69.61.97.121;branch=z9hG4bKcc3f.adecd464.0\r\nFrom: \"Extension\" <<a href="mailto:sip%3AVHEN1159@sip-25016.accounts-lab01.vocalocity.com" target="_blank">sip:VHEN1159@sip-25016.accounts-lab01.vocalocity.com</a>>;tag=7f8d85949a1a0c98o1\r\nCall-ID: cf60644-7d"..., </div>
<div> len=406, rcv_info=0xbf91f888) at receive.c:200</div><div> msg = 0x81a3ae4</div><div> __FUNCTION__ = "receive_msg"</div><div>#7 0x080c3105 in udp_rcv_loop () at udp_server.c:492</div><div>
len = 406</div><div> tmp = 0x13 <Address 0x13 out of bounds></div><div> from = 0x81a3ab8</div><div> fromlen = 16</div><div> ri = {src_ip = {af = 2, len = 4, u = {addrl = {2036415813, 3214014944, 3214014664, 0}, addr32 = {2036415813, 3214014944, 3214014664, 0}, addr16 = {15685, 31073, 63968, 49041, 63688, 49041, 0, 0}, </div>
<div> addr = "E=ay\340\371\221\277\310\370\221\277\000\000\000"}}, dst_ip = {af = 2, len = 4, u = {addrl = {2036415813, 0, 0, 0}, addr32 = {2036415813, 0, 0, 0}, addr16 = {15685, 31073, 0, 0, 0, 0, 0, 0}, </div>
<div> addr = "E=ay", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = "\023\304E=ay\000\000\000\000\000\000\000"}, </div>
<div> sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 2036415813}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 2036415813, sin6_addr = {in6_u = {</div>
<div> u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x819e878}</div><div> p = 0x0</div><div>
buf = "SIP/2.0 200 canceling\r\nVia: SIP/2.0/UDP 69.61.97.121;branch=z9hG4bKcc3f.adecd464.0\r\nFrom: \"Extension\" <<a href="mailto:sip%3AVHEN1159@sip-25016.accounts-lab01.vocalocity.com" target="_blank">sip:VHEN1159@sip-25016.accounts-lab01.vocalocity.com</a>>;tag=7f8d85949a1a0c98o1\r\nCall-ID: cf60644-7d"...</div>
<div> __FUNCTION__ = "udp_rcv_loop"</div><div>#8 0x08066b9a in main_loop () at main.c:818</div><div> i = 0</div><div> pid = 0</div><div> si = 0x819e878</div><div> startup_done = 0x0</div>
<div> chd_rank = 9</div><div> __FUNCTION__ = "main_loop"</div><div>#9 0x08068c3b in main (argc=3, argv=0xbf91fa64) at main.c:1388</div><div> cfg_log_stderr = 0</div><div> cfg_stream = 0x95b8008</div>
<div> c = -1</div><div> r = 0</div><div> tmp = 0xbf91f9a8 ""</div><div><br></div></div></div>
</blockquote></div><br></div>