The crash has happened again twice after this posting, in exactly the same place. Here's the bt of the latest core.<br><br>I can make two observations:<br><br>a) In the seven times we've experienced it so far, it's happened on either a NOTIFY (with message summary) or an OPTIONS (with no body) that hits the failure_route[softswitch] in the routing script here:<div>
<br></div><div><a href="http://pastebin.com/RmVVW8N7">http://pastebin.com/RmVVW8N7</a></div><div><br></div><div>b) The text ops call we're using that seems to cause this is the codec_delete_except_re() function -- which we invoke twice, once initially, and once again in the failure route as it recurses back through the main route setup.</div>
<div><meta http-equiv="content-type" content="text/html; charset=utf-8"><ol style="font-family: monospace; font-size: 12px; line-height: 18px; "><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
failure_route<span class="br0" style="color: rgb(0, 153, 0); ">[</span>softswitch<span class="br0" style="color: rgb(0, 153, 0); ">]</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
xlog<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">"failure route[$ci] -- softswitch -- reached -- load balancing $rm to a different destination, current destination is $dd for $ci"</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); "><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span><span class="br0" style="color: rgb(0, 153, 0); ">(</span>t_was_cancelled<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
exit<span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 221); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
</div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); "><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span> <span class="br0" style="color: rgb(0, 153, 0); ">(</span>t_check_status<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">"[4-5][0-9][0-9]"</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
lb_disable<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
xlog<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">"failure route[$ci] -- load balancer picked new destination for $rm, destination is $dd"</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
route<span class="br0" style="color: rgb(0, 153, 0); ">(</span>main<span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
exit<span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; color: rgb(24, 24, 24); ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; ">
<font class="Apple-style-span" color="#009900"><br></font></div><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; ">
<font class="Apple-style-span" color="#009900"><meta http-equiv="content-type" content="text/html; charset=utf-8"><span class="Apple-style-span" style="color: rgb(24, 24, 24); "><ol><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
</div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
route<span class="br0" style="color: rgb(0, 153, 0); ">[</span>filter_codecs<span class="br0" style="color: rgb(0, 153, 0); ">]</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span><span class="br0" style="color: rgb(0, 153, 0); ">(</span>has_body<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">"application/sdp"</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 221); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
codec_delete_except_re<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">"PCMA|PCMU|telephone-event"</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li></ol></span></font></div></li></ol><div><br><div class="gmail_quote"><br></div><div class="gmail_quote"><div class="gmail_quote">#0 backup () at codecs.c:104</div>
<div class="gmail_quote">104<span class="Apple-tab-span" style="white-space:pre">                                </span>int n = old->len;</div><div class="gmail_quote">(gdb) bt full</div><div class="gmail_quote">#0 backup () at codecs.c:104</div>
<div class="gmail_quote"> l = 0x7a1df0</div><div class="gmail_quote"> old = 0x0</div><div class="gmail_quote"> n = <value optimized out></div><div class="gmail_quote"> len = 1</div><div class="gmail_quote">
i = 0</div><div class="gmail_quote"> __FUNCTION__ = "backup"</div><div class="gmail_quote">#1 0x00002aeb40aea0e1 in pre_route_callback (msg=0x2aeb406c5140, param=0x7a2c80) at codecs.c:169</div><div class="gmail_quote">
No locals.</div><div class="gmail_quote">#2 0x000000000046d9be in exec_post_cb (msg=0x2aeb406c5140) at script_cb.c:198</div><div class="gmail_quote">No locals.</div><div class="gmail_quote">#3 exec_pre_route_cb (msg=0x2aeb406c5140) at script_cb.c:231</div>
<div class="gmail_quote">No locals.</div><div class="gmail_quote">#4 0x0000000000412153 in run_top_route (a=0x798070, msg=0x2aeb406c5140) at action.c:181</div><div class="gmail_quote"> bk_action_flags = 0</div><div class="gmail_quote">
bk_rec_lev = 0</div><div class="gmail_quote">#5 0x00002aeb404b178f in run_failure_handlers (Trans=0x2aeb4250b070, new_code=<value optimized out>, branch=<value optimized out>, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=<value optimized out>, </div>
<div class="gmail_quote"> reply=0x79f740) at t_reply.c:613</div><div class="gmail_quote"> faked_req = {id = 1024, first_line = {type = 1, len = 53, u = {request = {method = {</div><div class="gmail_quote"> s = 0x2aeb4252f5a8 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf"..., len = 7}, uri = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5b0 "<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0"..., len = 35}, version = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5d4 "SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060">217.73.175.1:5060</a>"..., len = 7}, method_value = 32}, reply = {version = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5a8 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf"..., len = 7}, status = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5b0 "<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0"..., len = 35}, reason = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5d4 "SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060">217.73.175.1:5060</a>"..., len = 7}, statuscode = 32}}}, via1 = 0x2aeb4252f8a0, via2 = 0x2aeb4252fa18, headers = 0x2aeb4252f810, last_header = 0x2aeb4252ffd8, parsed_flag = 18446744073709551615, h_via1 = 0x2aeb4252f858, h_via2 = 0x2aeb4252f9d0, </div>
<div class="gmail_quote"> callid = 0x2aeb4252ff90, to = 0x2aeb4252fce8, cseq = 0x2aeb4252ff18, from = 0x2aeb4252fc10, contact = 0x2aeb4252fed0, maxforwards = 0x2aeb4252ffd8, route = 0x0, record_route = 0x2aeb4252f810, path = 0x0, content_type = 0x0, </div>
<div class="gmail_quote"> content_length = 0x2aeb4252fbc8, authorization = 0x0, expires = 0x0, proxy_auth = 0x0, supported = 0x0, proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event = 0x0, accept = 0x2aeb4252fc58, accept_language = 0x0, </div>
<div class="gmail_quote"> organization = 0x0, priority = 0x0, subject = 0x0, user_agent = 0x2aeb4252fca0, content_disposition = 0x0, accept_disposition = 0x0, diversion = 0x0, rpid = 0x0, refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi = 0x0, </div>
<div class="gmail_quote"> pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh = 0x2aeb4252f80a "\r\n", unparsed = 0x2aeb4252f80a "\r\n", rcv = {src_ip = {af = 2, len = 4, u = {addrl = {4113468365, 6}, addr32 = {4113468365, 0, 6, 0}, addr16 = {35789, </div>
<div class="gmail_quote"> 62766, 0, 0, 6, 0, 0, 0}, addr = "͋.\365\000\000\000\000\006\000\000\000\000\000\000"}}, dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, </div>
<div class="gmail_quote"> 0}, addr = "͋.\226", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, </div>
<div class="gmail_quote"> sa_data = "\023\304͋.\365\000\000\000\000\000\000\000"}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 4113468365}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, </div>
<div class="gmail_quote"> sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr = {in6_u = {u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820}, </div>
<div class="gmail_quote"> buf = 0x2aeb4252f5a8 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf"..., len = 612, new_uri = {s = 0x7a1930 "<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a>", len = 35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0, parsed_uri = {user = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5b4 "<a href="mailto:100@internal-sip.mysipserver.com">100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVi"..., len = 3}, passwd = {s = 0x0, len = 0}, host = {</div>
<div class="gmail_quote"> s = 0x2aeb4252f5b8 "<a href="http://internal-sip.mysipserver.com">internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: <sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233>\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: S"..., len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, len = 0}, user_param = {s = 0x0, </div>
<div class="gmail_quote"> len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, user_param_val = {s = 0x0, len = 0}, </div>
<div class="gmail_quote"> maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user = {s = 0x0, len = 0}, passwd = {s = 0x0, </div>
<div class="gmail_quote"> len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = ERROR_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, </div>
<div class="gmail_quote"> len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, </div>
<div class="gmail_quote"> user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0, body_lumps = 0x0, reply_lump = 0x0, </div>
<div class="gmail_quote"> add_to_branch_s = '\000' <repeats 57 times>, add_to_branch_len = 0, hash_index = 4724, flags = 0, msg_flags = 32, set_global_address = {s = 0x0, len = 0}, set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0, </div>
<div class="gmail_quote"> path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}</div><div class="gmail_quote"> __FUNCTION__ = "run_failure_handlers"</div><div class="gmail_quote">#6 t_should_relay_response (Trans=0x2aeb4250b070, new_code=<value optimized out>, branch=<value optimized out>, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=<value optimized out>, reply=0x79f740)</div>
<div class="gmail_quote">at t_reply.c:911</div><div class="gmail_quote"> branch_cnt = 1</div><div class="gmail_quote"> picked_code = <value optimized out></div><div class="gmail_quote"> inv_through = <value optimized out></div>
<div class="gmail_quote"> do_cancel = 0</div><div class="gmail_quote"> __FUNCTION__ = "t_should_relay_response"</div><div class="gmail_quote">#7 0x00002aeb404b33a2 in relay_reply (t=0x7a1e00, p_msg=0x79f740, branch=1357051072, msg_status=404, cancel_bitmap=0x7a1df0) at t_reply.c:1125</div>
<div class="gmail_quote"> relay = <value optimized out></div><div class="gmail_quote"> save_clone = <value optimized out></div><div class="gmail_quote"> buf = <value optimized out></div>
<div class="gmail_quote"> res_len = 0</div><div class="gmail_quote"> relayed_code = 404</div><div class="gmail_quote"> relayed_msg = <value optimized out></div><div class="gmail_quote"> bm = {to_tag_val = {s = 0x7fff50e2f89c "", len = -1}}</div>
<div class="gmail_quote"> totag_retr = <value optimized out></div><div class="gmail_quote"> reply_status = 32767</div><div class="gmail_quote"> uas_rb = <value optimized out></div><div class="gmail_quote">
cb_s = {s = 0x79f740 "\377\003", len = 0}</div><div class="gmail_quote"> text = {s = 0x6e0000000b <Address 0x6e0000000b out of bounds>, len = 528}</div><div class="gmail_quote"> __FUNCTION__ = "relay_reply"</div>
<div class="gmail_quote">#8 0x00002aeb404b4990 in reply_received (p_msg=0x79f740) at t_reply.c:1494</div><div class="gmail_quote"> msg_status = 404</div><div class="gmail_quote"> branch = 1357051072</div><div class="gmail_quote">
reply_status = <value optimized out></div><div class="gmail_quote"> timer = <value optimized out></div><div class="gmail_quote"> cancel_bitmap = 0</div><div class="gmail_quote"> uac = 0x2aeb4250b248</div>
<div class="gmail_quote"> t = 0x2aeb4250b070</div><div class="gmail_quote"> backup_list = 0x0</div><div class="gmail_quote"> __FUNCTION__ = "reply_received"</div><div class="gmail_quote">#9 0x0000000000421ef4 in forward_reply (msg=0x79f740) at forward.c:561</div>
<div class="gmail_quote"> new_buf = <value optimized out></div><div class="gmail_quote"> to = <value optimized out></div><div class="gmail_quote"> new_len = <value optimized out></div>
<div class="gmail_quote"> mod = 0x7849f8</div><div class="gmail_quote"> proto = <value optimized out></div><div class="gmail_quote"> id = <value optimized out></div><div class="gmail_quote">
send_sock = <value optimized out></div><div class="gmail_quote"> len = <value optimized out></div><div class="gmail_quote"> __FUNCTION__ = "forward_reply"</div><div class="gmail_quote">
#10 0x00000000004570c2 in receive_msg (</div><div class="gmail_quote"> buf=0x758f40 "SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei"..., </div>
<div class="gmail_quote"> len=528, rcv_info=0x7fff50e2f980) at receive.c:200</div><div class="gmail_quote"> msg = 0x7a1e00</div><div class="gmail_quote"> __FUNCTION__ = "receive_msg"</div><div class="gmail_quote">
#11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492</div><div class="gmail_quote"> len = 528</div><div class="gmail_quote"> tmp = 0x13c4 <Address 0x13c4 out of bounds></div><div class="gmail_quote">
from = <value optimized out></div><div class="gmail_quote"> fromlen = 16</div><div class="gmail_quote"> ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805, 8}, addr32 = {3526265805, 0, 8, 0}, addr16 = {35789, 53806, 0, 0, 8, 0, 0, 0}, addr = "͋.\322\000\000\000\000\b\000\000\000\000\000\000"}}, dst_ip = {af = 2, len = 4, </div>
<div class="gmail_quote"> u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, 0}, addr = "͋.\226", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, </div>
<div class="gmail_quote"> proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = "\023\304͋.\322\000\000\000\000\000\000\000"}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 3526265805}, </div>
<div class="gmail_quote"> sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 3526265805, sin6_addr = {in6_u = {u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, </div>
<div class="gmail_quote">u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820}</div><div class="gmail_quote"> p = 0x0</div><div class="gmail_quote"> buf = "SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei"...</div>
<div class="gmail_quote"> __FUNCTION__ = "udp_rcv_loop"</div><div class="gmail_quote">#12 0x000000000042a65d in main_loop (argc=3, argv=<value optimized out>) at main.c:818</div><div class="gmail_quote">
i = 3</div><div class="gmail_quote"> pid = <value optimized out></div><div class="gmail_quote"> si = 0x0</div><div class="gmail_quote"> startup_done = 0x0</div><div class="gmail_quote"> chd_rank = 8</div>
<div class="gmail_quote"> __FUNCTION__ = "main_loop"</div><div class="gmail_quote">#13 main (argc=3, argv=<value optimized out>) at main.c:1388</div><div class="gmail_quote"> cfg_log_stderr = <value optimized out></div>
<div class="gmail_quote"> cfg_stream = 0xbc9e010</div><div class="gmail_quote"> c = <value optimized out></div><div class="gmail_quote"> r = <value optimized out></div><div class="gmail_quote">
tmp = 0x4fc457 "H\215\005\242\333#"</div><div class="gmail_quote"> tmp_len = <value optimized out></div><div class="gmail_quote"> port = <value optimized out></div><div class="gmail_quote">
proto = <value optimized out></div><div class="gmail_quote"> ret = <value optimized out></div><div class="gmail_quote"> seed = 2106089936</div><div class="gmail_quote"> rfd = <value optimized out></div>
<div class="gmail_quote"> __FUNCTION__ = "main"</div><div><br></div></div><div class="gmail_quote"><br></div><div class="gmail_quote">n Tue, Dec 7, 2010 at 10:52 AM, Bobby Smith <span dir="ltr"><<a href="mailto:bobby.smith@gmail.com">bobby.smith@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Hi Bogdan,<div><br></div><div><a href="http://pastebin.com/RmVVW8N7" target="_blank">http://pastebin.com/RmVVW8N7</a></div>
<div><br></div><div><a href="http://pastebin.com/RmVVW8N7" target="_blank"></a>If you look at calls to <span style="font-family:monospace;font-size:12px;color:rgb(24, 24, 24);line-height:18px">route</span><span style="font-family:monospace;font-size:12px;line-height:18px"><font color="#009900">(</font><font color="#181818">filter_codecs</font></span><span style="font-family:monospace;font-size:12px;line-height:18px"><font color="#009900">).</font></span></div>
<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">Also, the route(main) gets called on failure when a 4XX/5XX gets returned from our softswitch for load balancing purposes. This happens because the rtp proxies are on different hosts and we must attempt to reproxy the call.</span></span></font></div>
<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small"><br>
</span></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">If there is a cleaner way to do this, I'd appreciate it, but for the most part (except for the segfault) the above seems to work.</span></span></font></div>
<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small"><br>
Regards,</span></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">Bobby Smith</span></span></font></div>
<div><div></div><div class="h5">
<div><br><div class="gmail_quote">On Tue, Dec 7, 2010 at 6:57 AM, Bogdan-Andrei Iancu <span dir="ltr"><<a href="mailto:bogdan@voice-system.ro" target="_blank">bogdan@voice-system.ro</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Bobby,<br>
<br>
in what kind of routes do you use codec related ops ?<br>
<br>
Regards,<br>
Bogdan<br>
<br>
Bobby Smith wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>
On revision 7081 (opensips trunk), we've run into a couple of situations where cores were generated from a segfault. They both look the same, contents attached.<br>
<br>
<br>
#0 backup () at codecs.c:104<br>
104 int n = old->len;<br>
(gdb) bt full<br>
#0 backup () at codecs.c:104<br>
l = 0x79d8b0<br>
old = 0x0<br>
n = <value optimized out><br>
len = 1<br>
i = 0<br>
__FUNCTION__ = "backup"<br>
#1 0x00002b0d01fb00e1 in pre_route_callback (msg=0x2b0d01b8b140, param=0x79caf0) at codecs.c:169<br>
No locals.<br>
#2 0x000000000046d9be in exec_post_cb (msg=0x2b0d01b8b140) at script_cb.c:198<br>
No locals.<br>
#3 exec_pre_route_cb (msg=0x2b0d01b8b140) at script_cb.c:231<br>
No locals.<br>
#4 0x0000000000412153 in run_top_route (a=0x794e70, msg=0x2b0d01b8b140) at action.c:181<br>
bk_action_flags = 0<br>
bk_rec_lev = 0<br>
#5 0x00002b0d0197777f in run_failure_handlers (Trans=0x2b0d03954950, new_code=<value optimized out>, branch=<value optimized out>, should_store=0x7fff00703b58, should_relay=0x7fff00703b5c, cancel_bitmap=<value optimized out>,<br>
reply=0x796cc0) at t_reply.c:613<br>
faked_req = {id = 6, first_line = {type = 1, len = 53, u = {request = {method = {<br></div>
s = 0x2b0d0395bb00 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83"..., len = 7}, uri = {<br>
s = 0x2b0d0395bb08 "<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r"..., len = 35}, version = {<br>
s = 0x2b0d0395bb2c "SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> <<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>>"..., len = 7}, method_value = 32}, reply = {version = {<br>
s = 0x2b0d0395bb00 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83"..., len = 7}, status = {<br>
s = 0x2b0d0395bb08 "<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r"..., len = 35}, reason = {<br>
s = 0x2b0d0395bb2c "SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> <<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>>"..., len = 7}, statuscode = 32}}}, via1 = 0x2b0d0395bdf8, via2 = 0x2b0d0395bf70, headers = 0x2b0d0395bd68, last_header = 0x2b0d0395c530, parsed_flag = 18446744073709551615, h_via1 = 0x2b0d0395bdb0, h_via2 = 0x2b0d0395bf28,<div>
<br>
callid = 0x2b0d0395c4e8, to = 0x2b0d0395c240, cseq = 0x2b0d0395c470, from = 0x2b0d0395c168, contact = 0x2b0d0395c428, maxforwards = 0x2b0d0395c530, route = 0x0, record_route = 0x2b0d0395bd68, path = 0x0, content_type = 0x0,<br>
content_length = 0x2b0d0395c120, authorization = 0x0, expires = 0x0, proxy_auth = 0x0, supported = 0x0, proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event = 0x0, accept = 0x2b0d0395c1b0, accept_language = 0x0,<br>
organization = 0x0, priority = 0x0, subject = 0x0, user_agent = 0x2b0d0395c1f8, content_disposition = 0x0, accept_disposition = 0x0, diversion = 0x0, rpid = 0x0, refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi = 0x0,<br>
pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh = 0x2b0d0395bd63 "\r\n", unparsed = 0x2b0d0395bd63 "\r\n", rcv = {src_ip = {af = 2, len = 4, u = {addrl = {4113468365, 7}, addr32 = {4113468365, 0, 7, 0}, addr16 = {35789,<br>
62766, 0, 0, 7, 0, 0, 0}, addr = "Í.\365\000\000\000\000\a\000\000\000\000\000\000"}}, dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0,<br>
0}, addr = "Í.\226", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2,<br>
sa_data = "\023\304Í.\365\000\000\000\000\000\000\000"}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 4113468365}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2,<br>
sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr = {in6_u = {u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x795ca0},<br>
</div>
buf = 0x2b0d0395bb00 "OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83"..., len = 613, new_uri = {s = 0x79c4f0 "<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>>", len = 35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0, parsed_uri = {user = {<br>
s = 0x2b0d0395bb0c "<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a> <mailto:<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia"..., len = 3}, passwd = {s = 0x0, len = 0}, host = {<br>
s = 0x2b0d0395bb10 "<a href="http://internal-sip.mycompany.com" target="_blank">internal-sip.mycompany.com</a> <<a href="http://internal-sip.mycompany.com" target="_blank">http://internal-sip.mycompany.com</a>> SIP/2.0\r\nRecord-Route: <sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030>\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SI"..., len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, len = 0}, user_param = {s = 0x0,<div>
<div></div><div><br>
len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, user_param_val = {s = 0x0, len = 0},<br>
maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user = {s = 0x0, len = 0}, passwd = {s = 0x0,<br>
len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = ERROR_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0,<br>
len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0},<br>
user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0, body_lumps = 0x0, reply_lump = 0x0,<br>
add_to_branch_s = '\000' <repeats 57 times>, add_to_branch_len = 0, hash_index = 8312, flags = 0, msg_flags = 32, set_global_address = {s = 0x0, len = 0}, set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0,<br>
path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}<br>
__FUNCTION__ = "run_failure_handlers"<br>
#6 t_should_relay_response (Trans=0x2b0d03954950, new_code=<value optimized out>, branch=<value optimized out>, should_store=0x7fff00703b58, should_relay=0x7fff00703b5c, cancel_bitmap=<value optimized out>, reply=0x796cc0)<br>
at t_reply.c:911<br>
branch_cnt = 1<br>
picked_code = <value optimized out><br>
inv_through = <value optimized out><br>
do_cancel = 0<br>
__FUNCTION__ = "t_should_relay_response"<br>
#7 0x00002b0d01979392 in relay_reply (t=0x79c678, p_msg=0x796cc0, branch=7354464, msg_status=404, cancel_bitmap=0x79d8b0) at t_reply.c:1125<br>
relay = <value optimized out><br>
<br>
l = 0x79d8b0save_clone = <value optimized out><br>
buf = <value optimized out><br>
res_len = 0<br>
relayed_code = 404<br>
relayed_msg = <value optimized out><br>
bm = {to_tag_val = {s = 0x7fff00703c3c "", len = -1}}<br>
totag_retr = <value optimized out><br>
reply_status = RPS_ERROR<br>
uas_rb = <value optimized out><br>
cb_s = {s = 0x796cc0 "\005", len = 7704384}<br>
text = {s = 0x500000000796cc0 <Address 0x500000000796cc0 out of bounds>, len = 528}<br>
__FUNCTION__ = "relay_reply"<br>
#8 0x00002b0d0197a980 in reply_received (p_msg=0x796cc0) at t_reply.c:1494<br>
msg_status = 404<br>
branch = 7354464<br>
reply_status = <value optimized out><br>
timer = <value optimized out><br>
cancel_bitmap = 0<br>
uac = 0x2b0d03954b28<br>
t = 0x2b0d03954950<br>
backup_list = 0x0<br>
__FUNCTION__ = "reply_received"<br>
#9 0x0000000000421e98 in forward_reply (msg=0x796cc0) at forward.c:561<br>
new_buf = <value optimized out><br>
to = <value optimized out><br>
new_len = <value optimized out><br>
mod = 0x7849f8<br>
proto = <value optimized out><br>
id = <value optimized out><br>
send_sock = <value optimized out><br>
len = <value optimized out><br>
__FUNCTION__ = "forward_reply"<br>
#10 0x00000000004570c2 in receive_msg (<br>
buf=0x758f40 "SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP 109.104.88.29:5064;recei"...,<br>
len=528, rcv_info=0x7fff00703d20) at receive.c:200<br>
msg = 0x79c678<br>
__FUNCTION__ = "receive_msg"<br>
#11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492<br>
len = 528<br>
tmp = 0x13c4 <Address 0x13c4 out of bounds><br>
from = <value optimized out><br>
fromlen = 16<br>
ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805, 6}, addr32 = {3526265805, 0, 6, 0}, addr16 = {35789, 53806, 0, 0, 6, 0, 0, 0}, addr = "Í.\322\000\000\000\000\006\000\000\000\000\000\000"}}, dst_ip = {af = 2,<br>
len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, 0}, addr = "Í.\226", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto = 1,<br>
proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = "\023\304Í.\322\000\000\000\000\000\000\000"}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 3526265805},<br>
sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 3526265805, sin6_addr = {in6_u = {u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},<br>
u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x795ca0}<br>
p = 0x0<br>
buf = "SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP 109.104.88.29:5064;recei"...<br>
__FUNCTION__ = "udp_rcv_loop"<br>
#12 0x000000000042a65d in main_loop (argc=3, argv=<value optimized out>) at main.c:818<br>
i = 1<br>
pid = <value optimized out><br>
si = 0x0<br>
startup_done = 0x0<br>
chd_rank = 6<br>
__FUNCTION__ = "main_loop"<br>
#13 main (argc=3, argv=<value optimized out>) at main.c:1388<br>
cfg_log_stderr = <value optimized out><br>
cfg_stream = 0xf8d0010<br>
c = <value optimized out><br>
r = <value optimized out><br>
<br>
old = 0x0<br>
n = <value optimized out><br>
len = 1<br>
i = 0<br>
__FUNCTION__ = "backup"<br></div></div>
------------------------------------------------------------------------<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br>
</blockquote>
<br>
<br>
-- <br>
Bogdan-Andrei Iancu<br>
OpenSIPS Bootcamp<br>
15 - 19 November 2010, Edison, New Jersey, USA<br>
<a href="http://www.voice-system.ro" target="_blank">www.voice-system.ro</a><br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>