The crash has happened again twice after this posting, in exactly the same place.  Here&#39;s the bt of the latest core.<br><br>I can make two observations:<br><br>a) In the seven times we&#39;ve experienced it so far, it&#39;s happened on either a NOTIFY (with message summary) or an OPTIONS (with no body) that hits the failure_route[softswitch] in the routing script here:<div>
<br></div><div><a href="http://pastebin.com/RmVVW8N7">http://pastebin.com/RmVVW8N7</a></div><div><br></div><div>b) The text ops call we&#39;re using that seems to cause this is the codec_delete_except_re() function -- which we invoke twice, once initially, and once again in the failure route as it recurses back through the main route setup.</div>
<div><meta http-equiv="content-type" content="text/html; charset=utf-8"><ol style="font-family: monospace; font-size: 12px; line-height: 18px; "><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
failure_route<span class="br0" style="color: rgb(0, 153, 0); ">[</span>softswitch<span class="br0" style="color: rgb(0, 153, 0); ">]</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        xlog<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">&quot;failure route[$ci] -- softswitch -- reached -- load balancing $rm to a different destination, current destination is $dd for $ci&quot;</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); "><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span><span class="br0" style="color: rgb(0, 153, 0); ">(</span>t_was_cancelled<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                exit<span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 221); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
 </div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); "><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span> <span class="br0" style="color: rgb(0, 153, 0); ">(</span>t_check_status<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">&quot;[4-5][0-9][0-9]&quot;</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                lb_disable<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                xlog<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">&quot;failure route[$ci] -- load balancer picked new destination for $rm, destination is $dd&quot;</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); "><div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                route<span class="br0" style="color: rgb(0, 153, 0); ">(</span>main<span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); color: rgb(24, 24, 24); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                exit<span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); color: rgb(24, 24, 24); ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; color: rgb(24, 24, 24); ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; ">
<font class="Apple-style-span" color="#009900"><br></font></div><div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; ">
<font class="Apple-style-span" color="#009900"><meta http-equiv="content-type" content="text/html; charset=utf-8"><span class="Apple-style-span" style="color: rgb(24, 24, 24); "><ol><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
 </div></li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
route<span class="br0" style="color: rgb(0, 153, 0); ">[</span>filter_codecs<span class="br0" style="color: rgb(0, 153, 0); ">]</span> <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="kw1" style="color: rgb(0, 0, 0); font-weight: bold; ">if</span><span class="br0" style="color: rgb(0, 153, 0); ">(</span>has_body<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">&quot;application/sdp&quot;</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 221); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="br0" style="color: rgb(0, 153, 0); ">{</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
                codec_delete_except_re<span class="br0" style="color: rgb(0, 153, 0); ">(</span><span class="st0" style="color: rgb(0, 0, 255); ">&quot;PCMA|PCMU|telephone-event&quot;</span><span class="br0" style="color: rgb(0, 153, 0); ">)</span><span class="sy0" style="color: rgb(51, 153, 51); ">;</span></div>
</li><li class="li1" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(255, 255, 255); background-position: initial initial; background-repeat: initial initial; ">
<div class="de1" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
        <span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li><li class="li2" style="background-image: initial; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial; ">
<div class="de2" style="font: normal normal normal 1em/1.2em monospace; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; background-image: none; background-attachment: initial; background-origin: initial; background-clip: initial; background-color: initial; vertical-align: top; line-height: 18px; background-position: initial initial; background-repeat: initial initial; ">
<span class="br0" style="color: rgb(0, 153, 0); ">}</span></div></li></ol></span></font></div></li></ol><div><br><div class="gmail_quote"><br></div><div class="gmail_quote"><div class="gmail_quote">#0  backup () at codecs.c:104</div>
<div class="gmail_quote">104<span class="Apple-tab-span" style="white-space:pre">                                </span>int n = old-&gt;len;</div><div class="gmail_quote">(gdb) bt full</div><div class="gmail_quote">#0  backup () at codecs.c:104</div>
<div class="gmail_quote">        l = 0x7a1df0</div><div class="gmail_quote">        old = 0x0</div><div class="gmail_quote">        n = &lt;value optimized out&gt;</div><div class="gmail_quote">        len = 1</div><div class="gmail_quote">
        i = 0</div><div class="gmail_quote">        __FUNCTION__ = &quot;backup&quot;</div><div class="gmail_quote">#1  0x00002aeb40aea0e1 in pre_route_callback (msg=0x2aeb406c5140, param=0x7a2c80) at codecs.c:169</div><div class="gmail_quote">
No locals.</div><div class="gmail_quote">#2  0x000000000046d9be in exec_post_cb (msg=0x2aeb406c5140) at script_cb.c:198</div><div class="gmail_quote">No locals.</div><div class="gmail_quote">#3  exec_pre_route_cb (msg=0x2aeb406c5140) at script_cb.c:231</div>
<div class="gmail_quote">No locals.</div><div class="gmail_quote">#4  0x0000000000412153 in run_top_route (a=0x798070, msg=0x2aeb406c5140) at action.c:181</div><div class="gmail_quote">        bk_action_flags = 0</div><div class="gmail_quote">
        bk_rec_lev = 0</div><div class="gmail_quote">#5  0x00002aeb404b178f in run_failure_handlers (Trans=0x2aeb4250b070, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=&lt;value optimized out&gt;, </div>
<div class="gmail_quote">    reply=0x79f740) at t_reply.c:613</div><div class="gmail_quote">        faked_req = {id = 1024, first_line = {type = 1, len = 53, u = {request = {method = {</div><div class="gmail_quote">                  s = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 7}, uri = {</div>
<div class="gmail_quote">                  s = 0x2aeb4252f5b0 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0&quot;..., len = 35}, version = {</div>
<div class="gmail_quote">                  s = 0x2aeb4252f5d4 &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060">217.73.175.1:5060</a>&quot;..., len = 7}, method_value = 32}, reply = {version = {</div>
<div class="gmail_quote">                  s = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 7}, status = {</div>
<div class="gmail_quote">                  s = 0x2aeb4252f5b0 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0&quot;..., len = 35}, reason = {</div>
<div class="gmail_quote">                  s = 0x2aeb4252f5d4 &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060">217.73.175.1:5060</a>&quot;..., len = 7}, statuscode = 32}}}, via1 = 0x2aeb4252f8a0, via2 = 0x2aeb4252fa18, headers = 0x2aeb4252f810, last_header = 0x2aeb4252ffd8, parsed_flag = 18446744073709551615, h_via1 = 0x2aeb4252f858, h_via2 = 0x2aeb4252f9d0, </div>
<div class="gmail_quote">          callid = 0x2aeb4252ff90, to = 0x2aeb4252fce8, cseq = 0x2aeb4252ff18, from = 0x2aeb4252fc10, contact = 0x2aeb4252fed0, maxforwards = 0x2aeb4252ffd8, route = 0x0, record_route = 0x2aeb4252f810, path = 0x0, content_type = 0x0, </div>
<div class="gmail_quote">          content_length = 0x2aeb4252fbc8, authorization = 0x0, expires = 0x0, proxy_auth = 0x0, supported = 0x0, proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event = 0x0, accept = 0x2aeb4252fc58, accept_language = 0x0, </div>
<div class="gmail_quote">          organization = 0x0, priority = 0x0, subject = 0x0, user_agent = 0x2aeb4252fca0, content_disposition = 0x0, accept_disposition = 0x0, diversion = 0x0, rpid = 0x0, refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi = 0x0, </div>
<div class="gmail_quote">          pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh = 0x2aeb4252f80a &quot;\r\n&quot;, unparsed = 0x2aeb4252f80a &quot;\r\n&quot;, rcv = {src_ip = {af = 2, len = 4, u = {addrl = {4113468365, 6}, addr32 = {4113468365, 0, 6, 0}, addr16 = {35789, </div>
<div class="gmail_quote">                  62766, 0, 0, 6, 0, 0, 0}, addr = &quot;͋.\365\000\000\000\000\006\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, </div>
<div class="gmail_quote">                  0}, addr = &quot;͋.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, </div>
<div class="gmail_quote">                sa_data = &quot;\023\304͋.\365\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 4113468365}, sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2, </div>
<div class="gmail_quote">                sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820}, </div>
<div class="gmail_quote">          buf = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 612, new_uri = {s = 0x7a1930 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com">sip:100@internal-sip.mysipserver.com</a>&quot;, len = 35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0, parsed_uri = {user = {</div>
<div class="gmail_quote">              s = 0x2aeb4252f5b4 &quot;<a href="mailto:100@internal-sip.mysipserver.com">100@internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVi&quot;..., len = 3}, passwd = {s = 0x0, len = 0}, host = {</div>
<div class="gmail_quote">              s = 0x2aeb4252f5b8 &quot;<a href="http://internal-sip.mysipserver.com">internal-sip.mysipserver.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: S&quot;..., len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, len = 0}, user_param = {s = 0x0, </div>
<div class="gmail_quote">              len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, user_param_val = {s = 0x0, len = 0}, </div>
<div class="gmail_quote">            maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user = {s = 0x0, len = 0}, passwd = {s = 0x0, </div>
<div class="gmail_quote">              len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = ERROR_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, </div>
<div class="gmail_quote">              len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, </div>
<div class="gmail_quote">            user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0, body_lumps = 0x0, reply_lump = 0x0, </div>
<div class="gmail_quote">          add_to_branch_s = &#39;\000&#39; &lt;repeats 57 times&gt;, add_to_branch_len = 0, hash_index = 4724, flags = 0, msg_flags = 32, set_global_address = {s = 0x0, len = 0}, set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0, </div>
<div class="gmail_quote">          path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}</div><div class="gmail_quote">        __FUNCTION__ = &quot;run_failure_handlers&quot;</div><div class="gmail_quote">#6  t_should_relay_response (Trans=0x2aeb4250b070, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=&lt;value optimized out&gt;, reply=0x79f740)</div>
<div class="gmail_quote">at t_reply.c:911</div><div class="gmail_quote">        branch_cnt = 1</div><div class="gmail_quote">        picked_code = &lt;value optimized out&gt;</div><div class="gmail_quote">        inv_through = &lt;value optimized out&gt;</div>
<div class="gmail_quote">        do_cancel = 0</div><div class="gmail_quote">        __FUNCTION__ = &quot;t_should_relay_response&quot;</div><div class="gmail_quote">#7  0x00002aeb404b33a2 in relay_reply (t=0x7a1e00, p_msg=0x79f740, branch=1357051072, msg_status=404, cancel_bitmap=0x7a1df0) at t_reply.c:1125</div>
<div class="gmail_quote">        relay = &lt;value optimized out&gt;</div><div class="gmail_quote">        save_clone = &lt;value optimized out&gt;</div><div class="gmail_quote">        buf = &lt;value optimized out&gt;</div>
<div class="gmail_quote">        res_len = 0</div><div class="gmail_quote">        relayed_code = 404</div><div class="gmail_quote">        relayed_msg = &lt;value optimized out&gt;</div><div class="gmail_quote">        bm = {to_tag_val = {s = 0x7fff50e2f89c &quot;&quot;, len = -1}}</div>
<div class="gmail_quote">        totag_retr = &lt;value optimized out&gt;</div><div class="gmail_quote">        reply_status = 32767</div><div class="gmail_quote">        uas_rb = &lt;value optimized out&gt;</div><div class="gmail_quote">
        cb_s = {s = 0x79f740 &quot;\377\003&quot;, len = 0}</div><div class="gmail_quote">        text = {s = 0x6e0000000b &lt;Address 0x6e0000000b out of bounds&gt;, len = 528}</div><div class="gmail_quote">        __FUNCTION__ = &quot;relay_reply&quot;</div>
<div class="gmail_quote">#8  0x00002aeb404b4990 in reply_received (p_msg=0x79f740) at t_reply.c:1494</div><div class="gmail_quote">        msg_status = 404</div><div class="gmail_quote">        branch = 1357051072</div><div class="gmail_quote">
        reply_status = &lt;value optimized out&gt;</div><div class="gmail_quote">        timer = &lt;value optimized out&gt;</div><div class="gmail_quote">        cancel_bitmap = 0</div><div class="gmail_quote">        uac = 0x2aeb4250b248</div>
<div class="gmail_quote">        t = 0x2aeb4250b070</div><div class="gmail_quote">        backup_list = 0x0</div><div class="gmail_quote">        __FUNCTION__ = &quot;reply_received&quot;</div><div class="gmail_quote">#9  0x0000000000421ef4 in forward_reply (msg=0x79f740) at forward.c:561</div>
<div class="gmail_quote">        new_buf = &lt;value optimized out&gt;</div><div class="gmail_quote">        to = &lt;value optimized out&gt;</div><div class="gmail_quote">        new_len = &lt;value optimized out&gt;</div>
<div class="gmail_quote">        mod = 0x7849f8</div><div class="gmail_quote">        proto = &lt;value optimized out&gt;</div><div class="gmail_quote">        id = &lt;value optimized out&gt;</div><div class="gmail_quote">
        send_sock = &lt;value optimized out&gt;</div><div class="gmail_quote">        len = &lt;value optimized out&gt;</div><div class="gmail_quote">        __FUNCTION__ = &quot;forward_reply&quot;</div><div class="gmail_quote">
#10 0x00000000004570c2 in receive_msg (</div><div class="gmail_quote">    buf=0x758f40 &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei&quot;..., </div>
<div class="gmail_quote">    len=528, rcv_info=0x7fff50e2f980) at receive.c:200</div><div class="gmail_quote">        msg = 0x7a1e00</div><div class="gmail_quote">        __FUNCTION__ = &quot;receive_msg&quot;</div><div class="gmail_quote">
#11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492</div><div class="gmail_quote">        len = 528</div><div class="gmail_quote">        tmp = 0x13c4 &lt;Address 0x13c4 out of bounds&gt;</div><div class="gmail_quote">
        from = &lt;value optimized out&gt;</div><div class="gmail_quote">        fromlen = 16</div><div class="gmail_quote">        ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805, 8}, addr32 = {3526265805, 0, 8, 0}, addr16 = {35789, 53806, 0, 0, 8, 0, 0, 0}, addr = &quot;͋.\322\000\000\000\000\b\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2, len = 4, </div>
<div class="gmail_quote">            u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, 0}, addr = &quot;͋.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, </div>
<div class="gmail_quote">          proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = &quot;\023\304͋.\322\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 3526265805}, </div>
<div class="gmail_quote">              sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 3526265805, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, </div>
<div class="gmail_quote">u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820}</div><div class="gmail_quote">        p = 0x0</div><div class="gmail_quote">        buf = &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei&quot;...</div>
<div class="gmail_quote">        __FUNCTION__ = &quot;udp_rcv_loop&quot;</div><div class="gmail_quote">#12 0x000000000042a65d in main_loop (argc=3, argv=&lt;value optimized out&gt;) at main.c:818</div><div class="gmail_quote">
        i = 3</div><div class="gmail_quote">        pid = &lt;value optimized out&gt;</div><div class="gmail_quote">        si = 0x0</div><div class="gmail_quote">        startup_done = 0x0</div><div class="gmail_quote">        chd_rank = 8</div>
<div class="gmail_quote">        __FUNCTION__ = &quot;main_loop&quot;</div><div class="gmail_quote">#13 main (argc=3, argv=&lt;value optimized out&gt;) at main.c:1388</div><div class="gmail_quote">        cfg_log_stderr = &lt;value optimized out&gt;</div>
<div class="gmail_quote">        cfg_stream = 0xbc9e010</div><div class="gmail_quote">        c = &lt;value optimized out&gt;</div><div class="gmail_quote">        r = &lt;value optimized out&gt;</div><div class="gmail_quote">
        tmp = 0x4fc457 &quot;H\215\005\242\333#&quot;</div><div class="gmail_quote">        tmp_len = &lt;value optimized out&gt;</div><div class="gmail_quote">        port = &lt;value optimized out&gt;</div><div class="gmail_quote">
        proto = &lt;value optimized out&gt;</div><div class="gmail_quote">        ret = &lt;value optimized out&gt;</div><div class="gmail_quote">        seed = 2106089936</div><div class="gmail_quote">        rfd = &lt;value optimized out&gt;</div>
<div class="gmail_quote">        __FUNCTION__ = &quot;main&quot;</div><div><br></div></div><div class="gmail_quote"><br></div><div class="gmail_quote">n Tue, Dec 7, 2010 at 10:52 AM, Bobby Smith <span dir="ltr">&lt;<a href="mailto:bobby.smith@gmail.com">bobby.smith@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Hi Bogdan,<div><br></div><div><a href="http://pastebin.com/RmVVW8N7" target="_blank">http://pastebin.com/RmVVW8N7</a></div>
<div><br></div><div><a href="http://pastebin.com/RmVVW8N7" target="_blank"></a>If you look at calls to <span style="font-family:monospace;font-size:12px;color:rgb(24, 24, 24);line-height:18px">route</span><span style="font-family:monospace;font-size:12px;line-height:18px"><font color="#009900">(</font><font color="#181818">filter_codecs</font></span><span style="font-family:monospace;font-size:12px;line-height:18px"><font color="#009900">).</font></span></div>

<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">Also, the route(main) gets called on failure when a 4XX/5XX gets returned from our softswitch for load balancing purposes.  This happens because the rtp proxies are on different hosts and we must attempt to reproxy the call.</span></span></font></div>

<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small"><br>
</span></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">If there is a cleaner way to do this, I&#39;d appreciate it, but for the most part (except for the segfault) the above seems to work.</span></span></font></div>

<div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small"><br>
Regards,</span></span></font></div><div><font color="#009900" face="monospace"><span style="font-size:12px;line-height:18px"><span style="color:rgb(0, 0, 0);font-family:arial;line-height:normal;font-size:small">Bobby Smith</span></span></font></div>
<div><div></div><div class="h5">
<div><br><div class="gmail_quote">On Tue, Dec 7, 2010 at 6:57 AM, Bogdan-Andrei Iancu <span dir="ltr">&lt;<a href="mailto:bogdan@voice-system.ro" target="_blank">bogdan@voice-system.ro</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

Hi Bobby,<br>
<br>
in what kind of routes do you use codec related ops ?<br>
<br>
Regards,<br>
Bogdan<br>
<br>
Bobby Smith wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>
On revision 7081 (opensips trunk), we&#39;ve run into a couple of situations where cores were generated from a segfault.  They both look the same, contents attached.<br>
<br>
<br>
#0  backup () at codecs.c:104<br>
104                             int n = old-&gt;len;<br>
(gdb) bt full<br>
#0  backup () at codecs.c:104<br>
        l = 0x79d8b0<br>
        old = 0x0<br>
        n = &lt;value optimized out&gt;<br>
        len = 1<br>
        i = 0<br>
        __FUNCTION__ = &quot;backup&quot;<br>
#1  0x00002b0d01fb00e1 in pre_route_callback (msg=0x2b0d01b8b140, param=0x79caf0) at codecs.c:169<br>
No locals.<br>
#2  0x000000000046d9be in exec_post_cb (msg=0x2b0d01b8b140) at script_cb.c:198<br>
No locals.<br>
#3  exec_pre_route_cb (msg=0x2b0d01b8b140) at script_cb.c:231<br>
No locals.<br>
#4  0x0000000000412153 in run_top_route (a=0x794e70, msg=0x2b0d01b8b140) at action.c:181<br>
        bk_action_flags = 0<br>
        bk_rec_lev = 0<br>
#5  0x00002b0d0197777f in run_failure_handlers (Trans=0x2b0d03954950, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff00703b58, should_relay=0x7fff00703b5c, cancel_bitmap=&lt;value optimized out&gt;,<br>


    reply=0x796cc0) at t_reply.c:613<br>
        faked_req = {id = 6, first_line = {type = 1, len = 53, u = {request = {method = {<br></div>
                  s = 0x2b0d0395bb00 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len = 7}, uri = {<br>


                  s = 0x2b0d0395bb08 &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r&quot;..., len = 35}, version = {<br>


                  s = 0x2b0d0395bb2c &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;&quot;..., len = 7}, method_value = 32}, reply = {version = {<br>


                  s = 0x2b0d0395bb00 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len = 7}, status = {<br>


                  s = 0x2b0d0395bb08 &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r&quot;..., len = 35}, reason = {<br>


                  s = 0x2b0d0395bb2c &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;&quot;..., len = 7}, statuscode = 32}}}, via1 = 0x2b0d0395bdf8, via2 = 0x2b0d0395bf70, headers = 0x2b0d0395bd68, last_header = 0x2b0d0395c530, parsed_flag = 18446744073709551615, h_via1 = 0x2b0d0395bdb0, h_via2 = 0x2b0d0395bf28,<div>

<br>
          callid = 0x2b0d0395c4e8, to = 0x2b0d0395c240, cseq = 0x2b0d0395c470, from = 0x2b0d0395c168, contact = 0x2b0d0395c428, maxforwards = 0x2b0d0395c530, route = 0x0, record_route = 0x2b0d0395bd68, path = 0x0, content_type = 0x0,<br>


          content_length = 0x2b0d0395c120, authorization = 0x0, expires = 0x0, proxy_auth = 0x0, supported = 0x0, proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event = 0x0, accept = 0x2b0d0395c1b0, accept_language = 0x0,<br>


          organization = 0x0, priority = 0x0, subject = 0x0, user_agent = 0x2b0d0395c1f8, content_disposition = 0x0, accept_disposition = 0x0, diversion = 0x0, rpid = 0x0, refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi = 0x0,<br>


          pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh = 0x2b0d0395bd63 &quot;\r\n&quot;, unparsed = 0x2b0d0395bd63 &quot;\r\n&quot;, rcv = {src_ip = {af = 2, len = 4, u = {addrl = {4113468365, 7}, addr32 = {4113468365, 0, 7, 0}, addr16 = {35789,<br>


                  62766, 0, 0, 7, 0, 0, 0}, addr = &quot;Í.\365\000\000\000\000\a\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0,<br>


                  0}, addr = &quot;Í.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2,<br>
                sa_data = &quot;\023\304Í.\365\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 4113468365}, sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2,<br>


                sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x795ca0},<br>

</div>
          buf = 0x2b0d0395bb00 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len = 613, new_uri = {s = 0x79c4f0 &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;&quot;, len = 35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0, parsed_uri = {user = {<br>


              s = 0x2b0d0395bb0c &quot;<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a> &lt;mailto:<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia&quot;..., len = 3}, passwd = {s = 0x0, len = 0}, host = {<br>


              s = 0x2b0d0395bb10 &quot;<a href="http://internal-sip.mycompany.com" target="_blank">internal-sip.mycompany.com</a> &lt;<a href="http://internal-sip.mycompany.com" target="_blank">http://internal-sip.mycompany.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SI&quot;..., len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, len = 0}, user_param = {s = 0x0,<div>

<div></div><div><br>
              len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, user_param_val = {s = 0x0, len = 0},<br>


            maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user = {s = 0x0, len = 0}, passwd = {s = 0x0,<br>


              len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = ERROR_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0,<br>


              len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0},<br>


            user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0, body_lumps = 0x0, reply_lump = 0x0,<br>


          add_to_branch_s = &#39;\000&#39; &lt;repeats 57 times&gt;, add_to_branch_len = 0, hash_index = 8312, flags = 0, msg_flags = 32, set_global_address = {s = 0x0, len = 0}, set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0,<br>


          path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}<br>
        __FUNCTION__ = &quot;run_failure_handlers&quot;<br>
#6  t_should_relay_response (Trans=0x2b0d03954950, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff00703b58, should_relay=0x7fff00703b5c, cancel_bitmap=&lt;value optimized out&gt;, reply=0x796cc0)<br>


    at t_reply.c:911<br>
        branch_cnt = 1<br>
        picked_code = &lt;value optimized out&gt;<br>
        inv_through = &lt;value optimized out&gt;<br>
        do_cancel = 0<br>
        __FUNCTION__ = &quot;t_should_relay_response&quot;<br>
#7  0x00002b0d01979392 in relay_reply (t=0x79c678, p_msg=0x796cc0, branch=7354464, msg_status=404, cancel_bitmap=0x79d8b0) at t_reply.c:1125<br>
        relay = &lt;value optimized out&gt;<br>
<br>
l = 0x79d8b0save_clone = &lt;value optimized out&gt;<br>
        buf = &lt;value optimized out&gt;<br>
        res_len = 0<br>
        relayed_code = 404<br>
        relayed_msg = &lt;value optimized out&gt;<br>
        bm = {to_tag_val = {s = 0x7fff00703c3c &quot;&quot;, len = -1}}<br>
        totag_retr = &lt;value optimized out&gt;<br>
        reply_status = RPS_ERROR<br>
        uas_rb = &lt;value optimized out&gt;<br>
        cb_s = {s = 0x796cc0 &quot;\005&quot;, len = 7704384}<br>
        text = {s = 0x500000000796cc0 &lt;Address 0x500000000796cc0 out of bounds&gt;, len = 528}<br>
        __FUNCTION__ = &quot;relay_reply&quot;<br>
#8  0x00002b0d0197a980 in reply_received (p_msg=0x796cc0) at t_reply.c:1494<br>
        msg_status = 404<br>
        branch = 7354464<br>
        reply_status = &lt;value optimized out&gt;<br>
        timer = &lt;value optimized out&gt;<br>
        cancel_bitmap = 0<br>
        uac = 0x2b0d03954b28<br>
        t = 0x2b0d03954950<br>
        backup_list = 0x0<br>
        __FUNCTION__ = &quot;reply_received&quot;<br>
#9  0x0000000000421e98 in forward_reply (msg=0x796cc0) at forward.c:561<br>
        new_buf = &lt;value optimized out&gt;<br>
        to = &lt;value optimized out&gt;<br>
        new_len = &lt;value optimized out&gt;<br>
        mod = 0x7849f8<br>
        proto = &lt;value optimized out&gt;<br>
        id = &lt;value optimized out&gt;<br>
        send_sock = &lt;value optimized out&gt;<br>
        len = &lt;value optimized out&gt;<br>
        __FUNCTION__ = &quot;forward_reply&quot;<br>
#10 0x00000000004570c2 in receive_msg (<br>
    buf=0x758f40 &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP 109.104.88.29:5064;recei&quot;...,<br>


    len=528, rcv_info=0x7fff00703d20) at receive.c:200<br>
        msg = 0x79c678<br>
        __FUNCTION__ = &quot;receive_msg&quot;<br>
#11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492<br>
        len = 528<br>
        tmp = 0x13c4 &lt;Address 0x13c4 out of bounds&gt;<br>
        from = &lt;value optimized out&gt;<br>
        fromlen = 16<br>
        ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805, 6}, addr32 = {3526265805, 0, 6, 0}, addr16 = {35789, 53806, 0, 0, 6, 0, 0, 0}, addr = &quot;Í.\322\000\000\000\000\006\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2,<br>


            len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, 0}, addr = &quot;Í.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1,<br>


          proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = &quot;\023\304Í.\322\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 3526265805},<br>


              sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 3526265805, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},<br>


                  u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x795ca0}<br>
        p = 0x0<br>
        buf = &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SIP/2.0/UDP 109.104.88.29:5064;recei&quot;...<br>


        __FUNCTION__ = &quot;udp_rcv_loop&quot;<br>
#12 0x000000000042a65d in main_loop (argc=3, argv=&lt;value optimized out&gt;) at main.c:818<br>
        i = 1<br>
        pid = &lt;value optimized out&gt;<br>
        si = 0x0<br>
        startup_done = 0x0<br>
        chd_rank = 6<br>
        __FUNCTION__ = &quot;main_loop&quot;<br>
#13 main (argc=3, argv=&lt;value optimized out&gt;) at main.c:1388<br>
        cfg_log_stderr = &lt;value optimized out&gt;<br>
        cfg_stream = 0xf8d0010<br>
        c = &lt;value optimized out&gt;<br>
        r = &lt;value optimized out&gt;<br>
<br>
        old = 0x0<br>
        n = &lt;value optimized out&gt;<br>
        len = 1<br>
        i = 0<br>
        __FUNCTION__ = &quot;backup&quot;<br></div></div>
------------------------------------------------------------------------<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
  <br>
</blockquote>
<br>
<br>
-- <br>
Bogdan-Andrei Iancu<br>
OpenSIPS Bootcamp<br>
15 - 19 November 2010, Edison, New Jersey, USA<br>
<a href="http://www.voice-system.ro" target="_blank">www.voice-system.ro</a><br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>