<div>We&#39;re currently seeing some crashing around the same area of code even after applying the patch fix from trunk:</div><div><br></div><div><div>#0  0x00002b5a5bbfa0f6 in stream_process (msg=0x7a2f38, str1=0x0, str2=0x0, re=0x7994e8, op=1, desc=3) at codecs.c:524</div>
<div>524<span class="Apple-tab-span" style="white-space:pre">                                        </span>temp = payload-&gt;rtp_enc.s[payload-&gt;rtp_enc.len];</div><div>(gdb) list</div><div>519<span class="Apple-tab-span" style="white-space:pre">                                </span>match = 0;</div>
<div>520<span class="Apple-tab-span" style="white-space:pre">        </span></div><div>521<span class="Apple-tab-span" style="white-space:pre">                                </span>if( description == DESC_REGEXP ||description == DESC_REGEXP_COMPLEMENT )</div>
<div>522<span class="Apple-tab-span" style="white-space:pre">                                </span>{</div><div>523<span class="Apple-tab-span" style="white-space:pre">                                        </span>/* try to match a regexp */</div><div>524<span class="Apple-tab-span" style="white-space:pre">                                        </span>temp = payload-&gt;rtp_enc.s[payload-&gt;rtp_enc.len];</div>
<div>525<span class="Apple-tab-span" style="white-space:pre">                                        </span>payload-&gt;rtp_enc.s[payload-&gt;rtp_enc.len] = 0;</div><div>526<span class="Apple-tab-span" style="white-space:pre">                                        </span>match = regexec( re, payload-&gt;rtp_enc.s, 1, &amp;pmatch, 0) == 0;</div>
<div>527<span class="Apple-tab-span" style="white-space:pre">                                        </span>payload-&gt;rtp_enc.s[payload-&gt;rtp_enc.len] = temp;</div><div>528<span class="Apple-tab-span" style="white-space:pre">                                </span>}</div><div>(gdb) info locals</div>
<div>payload = 0x79d030</div><div>lmp = 0x7a6c58</div><div>depl = &lt;value optimized out&gt;</div><div>match = 8022576</div><div>cur = 0x1 &lt;Address 0x1 out of bounds&gt;</div><div>buff = 0x7a0e98 &quot;pstn=500&quot;</div>
<div>temp = -88 &#39;\250&#39;</div><div>ret = 0</div><div>i = &lt;value optimized out&gt;</div><div>pmatch = {rm_so = 5, rm_eo = 0}</div><div>__FUNCTION__ = &quot;stream_process&quot;</div></div><div><br></div><div><br></div>
<div><div>#0  0x00002b5a5bbfa0f6 in stream_process (msg=0x7a2f38, str1=0x0, str2=0x0, re=0x7994e8, op=1, desc=3) at codecs.c:524</div><div>        payload = 0x79d030</div><div>        lmp = 0x7a6c58</div><div>        depl = &lt;value optimized out&gt;</div>
<div>        match = 8022576</div><div>        cur = 0x1 &lt;Address 0x1 out of bounds&gt;</div><div>        buff = 0x7a0e98 &quot;pstn=500&quot;</div><div>        temp = -88 &#39;\250&#39;</div><div>        ret = 0</div>
<div>        i = &lt;value optimized out&gt;</div><div>        pmatch = {rm_so = 5, rm_eo = 0}</div><div>        __FUNCTION__ = &quot;stream_process&quot;</div><div>#1  do_for_all_streams (msg=0x7a2f38, str1=0x0, str2=0x0, re=0x7994e8, op=1, desc=3) at codecs.c:408</div>
<div>        cur_cell = 0x7a6a30</div><div>        cur_session = 0x79b7f0</div><div>        rez = &lt;value optimized out&gt;</div><div>        __FUNCTION__ = &quot;do_for_all_streams&quot;</div><div>#2  0x00002b5a5bbfa785 in codec_delete_except_re (msg=0x0, str1=0x7a6a30 &quot;&quot;) at codecs.c:748</div>
<div>No locals.</div><div>#3  0x000000000040e978 in do_action (a=0x799828, msg=0x7a2f38) at action.c:1045</div><div>        val_s = {s = 0x6a &lt;Address 0x6a out of bounds&gt;, len = 331625791}</div><div>        aux = {s = 0x521b8f &quot;&quot;, len = 5381007}</div>
<div>        ret = &lt;value optimized out&gt;</div><div>        v = &lt;value optimized out&gt;</div><div>        to = &lt;value optimized out&gt;</div><div>        p = &lt;value optimized out&gt;</div><div>        tmp = &lt;value optimized out&gt;</div>
<div>        new_uri = &lt;value optimized out&gt;</div><div>        end = &lt;value optimized out&gt;</div><div>        crt = &lt;value optimized out&gt;</div><div>        len = &lt;value optimized out&gt;</div></div><div>
<br></div><div><div>(gdb) print payload</div><div>$4 = (sdp_payload_attr_t *) 0x79d030</div><div>(gdb) print *payload</div><div>$5 = {next = 0x79a9e8, payload_num = 1, rtp_payload = {s = 0x7592d8 &quot;8 18 101\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 P\r\na=nortpproxy:yes\r\n&quot;, len = 1}, rtp_enc = {s = 0x759303 &quot;P\r\na=nortpproxy:yes\r\n&quot;, len = -7705347}, </div>
<div>  rtp_clock = {s = 0x1 &lt;Address 0x1 out of bounds&gt;, len = 7705347}, rtp_params = {s = 0x0, len = 0}, sendrecv_mode = {s = 0x0, len = 0}, ptime = {s = 0x0, len = 0}, fmtp_string = {s = 0x0, len = 0}}</div><div>(gdb) print *payload-&gt;rtp_enc</div>
<div>Structure has no component named operator*.</div><div>(gdb) print payload-&gt;rtp_enc</div><div>$6 = {s = 0x759303 &quot;P\r\na=nortpproxy:yes\r\n&quot;, len = -7705347}</div><div>(gdb) print payload-&gt;rtp_enc.s</div>
<div>$7 = 0x759303 &quot;P\r\na=nortpproxy:yes\r\n&quot;</div><div>(gdb) print payload-&gt;rtp_enc.s</div><div>$8 = 0x759303 &quot;P\r\na=nortpproxy:yes\r\n&quot;</div><div>(gdb) print rtp_enc.len</div><div>No symbol &quot;rtp_enc&quot; in current context.</div>
<div>(gdb) print payload-&gt;rtp_enc</div><div>$9 = {s = 0x759303 &quot;P\r\na=nortpproxy:yes\r\n&quot;, len = -7705347}</div><div>(gdb) print payload-&gt;rtp_enc.len</div><div>$10 = -7705347</div><div>(gdb) </div></div><div>
<br></div><div><br></div><div>I will comment that part of the SDP is truncated, and it looks like the nortpproxy:yes string is appended after that:</div><div><br></div><div><div>(gdb) print val_s.s</div><div>$12 = 0x759004 &quot;<a href="mailto:973f4230367e88d0c06ccd6f70e8ed72@10.2.1.43">973f4230367e88d0c06ccd6f70e8ed72@10.2.1.43</a>\r\nCSeq: 32621 INVITE\r\nFrom: \&quot;WASHINGTON   DC\&quot; &lt;<a href="mailto:sip%3A1234567890@10.2.1.43">sip:1234567890@10.2.1.43</a>&gt;;tag=3383745851297549218022\r\nTo: &lt;<a href="mailto:sip%3A18042181197@external.com">sip:18042181197@external.com</a>&gt;\r\nVia: SIP/2.0/UDP 4.2.2.3;branch=z9hG4bKf86.d04be483.0\r\nVia: SIP/2.0/UDP 10.2.1.43:5060;branch=z9hG4bK1735452086568519500666701297549218024\r\nMax-Forwards: 68\r\nContact: \&quot;Foo\&quot; &lt;sip:<meta http-equiv="content-type" content="text/html; charset=utf-8"><a href="http://1234567890@10.2.1.43:5060">1234567890@10.2.1.43:5060</a>&gt;;transport=udp\r\nContent-Type: application/sdp\r\nAllow: INVITE, OPTIONS, BYE, CANCEL, ACK, REFER, NOTIFY, INFO, PRACK\r\nUser-Agent: Foo/<a href="http://6.2.0.30">6.2.0.30</a>\r\nContent-Length: 207\r\n\r\nv=0\r\no=Foo 1297549218020 1297549218020 IN IP4 10.2.1.43\r\ns=SIP Media Capabilities\r\nc=IN IP4 4.2.2.1\r\nt=0 0\r\nm=audio 25560 RTP/AVP 0 8 18 101\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 P\r\na=nortpproxy:yes\r\n&quot;</div>
</div><br><div class="gmail_quote">On Tue, Dec 21, 2010 at 10:14 PM, Bobby Smith <span dir="ltr">&lt;<a href="mailto:bobby.smith@gmail.com">bobby.smith@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hi Bogdan,<div><br>We currently have this patch installed and have been consistent for more than a couple of days now, so we&#39;re looking good.</div><div><br>Thanks again for all your help.</div><div><br></div><div>Regards,</div>

<div>Bobby Smith<div><div></div><div class="h5"><br><br><div class="gmail_quote">On Tue, Dec 21, 2010 at 8:33 AM, Bogdan-Andrei Iancu <span dir="ltr">&lt;<a href="mailto:bogdan@voice-system.ro" target="_blank">bogdan@voice-system.ro</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Bobby,<br>
<br>
Could you confirm that the latest fixes on trunk (for codec ops) solved your problem ?<div><br><br>
Regards,<br>
Bogdan<br>
<br>
Bobby Smith wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>
The crash has happened again twice after this posting, in exactly the same place. Here&#39;s the bt of the latest core.<br>
<br>
I can make two observations:<br>
<br>
a) In the seven times we&#39;ve experienced it so far, it&#39;s happened on either a NOTIFY (with message summary) or an OPTIONS (with no body) that hits the failure_route[softswitch] in the routing script here:<br>
<br>
<a href="http://pastebin.com/RmVVW8N7" target="_blank">http://pastebin.com/RmVVW8N7</a><br>
<br>
b) The text ops call we&#39;re using that seems to cause this is the codec_delete_except_re() function -- which we invoke twice, once initially, and once again in the failure route as it recurses back through the main route setup.<br>


<br></div>
  1.<br>
      failure_route[softswitch] {<br>
  2.<div><br>
      xlog(&quot;failure route[$ci] -- softswitch -- reached -- load<br>
      balancing $rm to a different destination, current destination is<br>
      $dd for $ci&quot;);<br></div>
  3.<br>
      if(t_was_cancelled()) {<br>
  4.<br>
      exit;<br>
  5.<br>
      }<br>
  6.<br>
  7.<div><br>
      if (t_check_status(&quot;[4-5][0-9][0-9]&quot;)) {<br></div>
  8.<br>
      lb_disable();<br>
  9.<div><br>
      xlog(&quot;failure route[$ci] -- load balancer picked new destination<br>
      for $rm, destination is $dd&quot;);<br></div>
 10.<br>
      route(main);<br>
 11.<br>
      exit;<br>
 12.<br>
      }<br>
 13.<br>
      }<br>
<br>
        1.<br>
        2.<br>
            route[filter_codecs] {<br>
        3.<div><br>
            if(has_body(&quot;application/sdp&quot;))<br></div>
        4.<br>
            {<br>
        5.<div><br>
            codec_delete_except_re(&quot;PCMA|PCMU|telephone-event&quot;);<br></div>
        6.<br>
            }<br>
        7.<div><br>
            }<br>
<br>
<br>
<br>
#0 backup () at codecs.c:104<br>
104 int n = old-&gt;len;<br>
(gdb) bt full<br>
#0 backup () at codecs.c:104<br>
l = 0x7a1df0<br>
old = 0x0<br>
n = &lt;value optimized out&gt;<br>
len = 1<br>
i = 0<br>
__FUNCTION__ = &quot;backup&quot;<br>
#1 0x00002aeb40aea0e1 in pre_route_callback (msg=0x2aeb406c5140, param=0x7a2c80) at codecs.c:169<br>
No locals.<br>
#2 0x000000000046d9be in exec_post_cb (msg=0x2aeb406c5140) at script_cb.c:198<br>
No locals.<br>
#3 exec_pre_route_cb (msg=0x2aeb406c5140) at script_cb.c:231<br>
No locals.<br>
#4 0x0000000000412153 in run_top_route (a=0x798070, msg=0x2aeb406c5140) at action.c:181<br>
bk_action_flags = 0<br>
bk_rec_lev = 0<br>
#5 0x00002aeb404b178f in run_failure_handlers (Trans=0x2aeb4250b070, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=&lt;value optimized out&gt;,<br>


reply=0x79f740) at t_reply.c:613<br>
faked_req = {id = 1024, first_line = {type = 1, len = 53, u = {request = {method = {<br></div>
s = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 7}, uri = {<br>


s = 0x2aeb4252f5b0 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0&quot;..., len = 35}, version = {<br>


s = 0x2aeb4252f5d4 &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060" target="_blank">217.73.175.1:5060</a> &lt;<a href="http://217.73.175.1:5060" target="_blank">http://217.73.175.1:5060</a>&gt;&quot;..., len = 7}, method_value = 32}, reply = {version = {<br>


s = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 7}, status = {<br>


s = 0x2aeb4252f5b0 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0&quot;..., len = 35}, reason = {<br>


s = 0x2aeb4252f5d4 &quot;SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP <a href="http://217.73.175.1:5060" target="_blank">217.73.175.1:5060</a> &lt;<a href="http://217.73.175.1:5060" target="_blank">http://217.73.175.1:5060</a>&gt;&quot;..., len = 7}, statuscode = 32}}}, via1 = 0x2aeb4252f8a0, via2 = 0x2aeb4252fa18, headers = 0x2aeb4252f810, last_header = 0x2aeb4252ffd8, parsed_flag = 18446744073709551615, h_via1 = 0x2aeb4252f858, h_via2 = 0x2aeb4252f9d0,<div>

<br>
callid = 0x2aeb4252ff90, to = 0x2aeb4252fce8, cseq = 0x2aeb4252ff18, from = 0x2aeb4252fc10, contact = 0x2aeb4252fed0, maxforwards = 0x2aeb4252ffd8, route = 0x0, record_route = 0x2aeb4252f810, path = 0x0, content_type = 0x0,<br>


content_length = 0x2aeb4252fbc8, authorization = 0x0, expires = 0x0, proxy_auth = 0x0, supported = 0x0, proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event = 0x0, accept = 0x2aeb4252fc58, accept_language = 0x0,<br>


organization = 0x0, priority = 0x0, subject = 0x0, user_agent = 0x2aeb4252fca0, content_disposition = 0x0, accept_disposition = 0x0, diversion = 0x0, rpid = 0x0, refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi = 0x0,<br>


pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh = 0x2aeb4252f80a &quot;\r\n&quot;, unparsed = 0x2aeb4252f80a &quot;\r\n&quot;, rcv = {src_ip = {af = 2, len = 4, u = {addrl = {4113468365, 6}, addr32 = {4113468365, 0, 6, 0}, addr16 = {35789,<br>


62766, 0, 0, 6, 0, 0, 0}, addr = &quot;͋.\365\000\000\000\000\006\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0,<br>


0}, addr = &quot;͋.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2,<br>
sa_data = &quot;\023\304͋.\365\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 4113468365}, sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2,<br>


sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820},<br>

</div>
buf = 0x2aeb4252f5a8 &quot;OPTIONS <a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf&quot;..., len = 612, new_uri = {s = 0x7a1930 &quot;<a href="mailto:sip%3A100@internal-sip.mysipserver.com" target="_blank">sip:100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mysipserver.com" target="_blank">sip%3A100@internal-sip.mysipserver.com</a>&gt;&quot;, len = 35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0, parsed_uri = {user = {<br>


s = 0x2aeb4252f5b4 &quot;<a href="mailto:100@internal-sip.mysipserver.com" target="_blank">100@internal-sip.mysipserver.com</a> &lt;mailto:<a href="mailto:100@internal-sip.mysipserver.com" target="_blank">100@internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVi&quot;..., len = 3}, passwd = {s = 0x0, len = 0}, host = {<br>


s = 0x2aeb4252f5b8 &quot;<a href="http://internal-sip.mysipserver.com" target="_blank">internal-sip.mysipserver.com</a> &lt;<a href="http://internal-sip.mysipserver.com" target="_blank">http://internal-sip.mysipserver.com</a>&gt; SIP/2.0\r\nRecord-Route: &lt;sip:4.2.2.245;lr=on;ftag=6364386232656635313363340131333138353238393233&gt;\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: S&quot;..., len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0, len = 0}, user_param = {s = 0x0,<div>

<div></div><div><br>
len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0}, user_param_val = {s = 0x0, len = 0},<br>


maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user = {s = 0x0, len = 0}, passwd = {s = 0x0,<br>
len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto = 0, type = ERROR_URI_T, transport = {s = 0x0, len = 0}, ttl = {s = 0x0,<br>
len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s = 0x0, len = 0},<br>
user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0, body_lumps = 0x0, reply_lump = 0x0,<br>
add_to_branch_s = &#39;\000&#39; &lt;repeats 57 times&gt;, add_to_branch_len = 0, hash_index = 4724, flags = 0, msg_flags = 32, set_global_address = {s = 0x0, len = 0}, set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0,<br>


path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}<br>
__FUNCTION__ = &quot;run_failure_handlers&quot;<br>
#6 t_should_relay_response (Trans=0x2aeb4250b070, new_code=&lt;value optimized out&gt;, branch=&lt;value optimized out&gt;, should_store=0x7fff50e2f7b8, should_relay=0x7fff50e2f7bc, cancel_bitmap=&lt;value optimized out&gt;, reply=0x79f740)<br>


at t_reply.c:911<br>
branch_cnt = 1<br>
picked_code = &lt;value optimized out&gt;<br>
inv_through = &lt;value optimized out&gt;<br>
do_cancel = 0<br>
__FUNCTION__ = &quot;t_should_relay_response&quot;<br>
#7 0x00002aeb404b33a2 in relay_reply (t=0x7a1e00, p_msg=0x79f740, branch=1357051072, msg_status=404, cancel_bitmap=0x7a1df0) at t_reply.c:1125<br>
relay = &lt;value optimized out&gt;<br>
save_clone = &lt;value optimized out&gt;<br>
buf = &lt;value optimized out&gt;<br>
res_len = 0<br>
relayed_code = 404<br>
relayed_msg = &lt;value optimized out&gt;<br>
bm = {to_tag_val = {s = 0x7fff50e2f89c &quot;&quot;, len = -1}}<br>
totag_retr = &lt;value optimized out&gt;<br>
reply_status = 32767<br>
uas_rb = &lt;value optimized out&gt;<br>
cb_s = {s = 0x79f740 &quot;\377\003&quot;, len = 0}<br>
text = {s = 0x6e0000000b &lt;Address 0x6e0000000b out of bounds&gt;, len = 528}<br>
__FUNCTION__ = &quot;relay_reply&quot;<br>
#8 0x00002aeb404b4990 in reply_received (p_msg=0x79f740) at t_reply.c:1494<br>
msg_status = 404<br>
branch = 1357051072<br>
reply_status = &lt;value optimized out&gt;<br>
timer = &lt;value optimized out&gt;<br>
cancel_bitmap = 0<br>
uac = 0x2aeb4250b248<br>
t = 0x2aeb4250b070<br>
backup_list = 0x0<br>
__FUNCTION__ = &quot;reply_received&quot;<br>
#9 0x0000000000421ef4 in forward_reply (msg=0x79f740) at forward.c:561<br>
new_buf = &lt;value optimized out&gt;<br>
to = &lt;value optimized out&gt;<br>
new_len = &lt;value optimized out&gt;<br>
mod = 0x7849f8<br>
proto = &lt;value optimized out&gt;<br>
id = &lt;value optimized out&gt;<br>
send_sock = &lt;value optimized out&gt;<br>
len = &lt;value optimized out&gt;<br>
__FUNCTION__ = &quot;forward_reply&quot;<br>
#10 0x00000000004570c2 in receive_msg (<br>
buf=0x758f40 &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei&quot;...,<br>


len=528, rcv_info=0x7fff50e2f980) at receive.c:200<br>
msg = 0x7a1e00<br>
__FUNCTION__ = &quot;receive_msg&quot;<br>
#11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492<br>
len = 528<br>
tmp = 0x13c4 &lt;Address 0x13c4 out of bounds&gt;<br>
from = &lt;value optimized out&gt;<br>
fromlen = 16<br>
ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805, 8}, addr32 = {3526265805, 0, 8, 0}, addr16 = {35789, 53806, 0, 0, 8, 0, 0, 0}, addr = &quot;͋.\322\000\000\000\000\b\000\000\000\000\000\000&quot;}}, dst_ip = {af = 2, len = 4,<br>


u = {addrl = {2519632845, 0}, addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0, 0, 0}, addr = &quot;͋.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0,<br>


proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = &quot;\023\304͋.\322\000\000\000\000\000\000\000&quot;}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 3526265805},<br>
sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 3526265805, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},<br>


u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x799820}<br>
p = 0x0<br>
buf = &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP 4.2.2.150;branch=z9hG4bK4721.ad8f7017.0;rport=5060\r\nVia: SIP/2.0/UDP 4.2.2.245;branch=z9hG4bK4721.cf01ae25.0\r\nVia: SIP/2.0/UDP 217.73.175.1:5060;recei&quot;...<br>


__FUNCTION__ = &quot;udp_rcv_loop&quot;<br>
#12 0x000000000042a65d in main_loop (argc=3, argv=&lt;value optimized out&gt;) at main.c:818<br>
i = 3<br>
pid = &lt;value optimized out&gt;<br>
si = 0x0<br>
startup_done = 0x0<br>
chd_rank = 8<br>
__FUNCTION__ = &quot;main_loop&quot;<br>
#13 main (argc=3, argv=&lt;value optimized out&gt;) at main.c:1388<br>
cfg_log_stderr = &lt;value optimized out&gt;<br>
cfg_stream = 0xbc9e010<br>
c = &lt;value optimized out&gt;<br>
r = &lt;value optimized out&gt;<br>
tmp = 0x4fc457 &quot;H\215\005\242\333#&quot;<br>
tmp_len = &lt;value optimized out&gt;<br>
port = &lt;value optimized out&gt;<br>
proto = &lt;value optimized out&gt;<br>
ret = &lt;value optimized out&gt;<br>
seed = 2106089936<br>
rfd = &lt;value optimized out&gt;<br>
__FUNCTION__ = &quot;main&quot;<br>
<br>
<br></div></div><div>
n Tue, Dec 7, 2010 at 10:52 AM, Bobby Smith &lt;<a href="mailto:bobby.smith@gmail.com" target="_blank">bobby.smith@gmail.com</a> &lt;mailto:<a href="mailto:bobby.smith@gmail.com" target="_blank">bobby.smith@gmail.com</a>&gt;&gt; wrote:<br>


<br>
    Hi Bogdan,<br>
<br>
    <a href="http://pastebin.com/RmVVW8N7" target="_blank">http://pastebin.com/RmVVW8N7</a><br>
<br>
    If you look at calls to route(filter_codecs).<br>
<br>
    Also, the route(main) gets called on failure when a 4XX/5XX gets<br>
    returned from our softswitch for load balancing purposes. This<br>
    happens because the rtp proxies are on different hosts and we must<br>
    attempt to reproxy the call.<br>
<br>
    If there is a cleaner way to do this, I&#39;d appreciate it, but for<br>
    the most part (except for the segfault) the above seems to work.<br>
<br>
    Regards,<br>
    Bobby Smith<br>
<br>
    On Tue, Dec 7, 2010 at 6:57 AM, Bogdan-Andrei Iancu<br></div><div><div></div><div>
    &lt;<a href="mailto:bogdan@voice-system.ro" target="_blank">bogdan@voice-system.ro</a> &lt;mailto:<a href="mailto:bogdan@voice-system.ro" target="_blank">bogdan@voice-system.ro</a>&gt;&gt; wrote:<br>
<br>
        Hi Bobby,<br>
<br>
        in what kind of routes do you use codec related ops ?<br>
<br>
        Regards,<br>
        Bogdan<br>
<br>
        Bobby Smith wrote:<br>
<br>
            On revision 7081 (opensips trunk), we&#39;ve run into a couple<br>
            of situations where cores were generated from a segfault.<br>
            They both look the same, contents attached.<br>
<br>
<br>
            #0 backup () at codecs.c:104<br>
            104 int n = old-&gt;len;<br>
            (gdb) bt full<br>
            #0 backup () at codecs.c:104<br>
            l = 0x79d8b0<br>
            old = 0x0<br>
            n = &lt;value optimized out&gt;<br>
            len = 1<br>
            i = 0<br>
            __FUNCTION__ = &quot;backup&quot;<br>
            #1 0x00002b0d01fb00e1 in pre_route_callback<br>
            (msg=0x2b0d01b8b140, param=0x79caf0) at codecs.c:169<br>
            No locals.<br>
            #2 0x000000000046d9be in exec_post_cb (msg=0x2b0d01b8b140)<br>
            at script_cb.c:198<br>
            No locals.<br>
            #3 exec_pre_route_cb (msg=0x2b0d01b8b140) at script_cb.c:231<br>
            No locals.<br>
            #4 0x0000000000412153 in run_top_route (a=0x794e70,<br>
            msg=0x2b0d01b8b140) at action.c:181<br>
            bk_action_flags = 0<br>
            bk_rec_lev = 0<br>
            #5 0x00002b0d0197777f in run_failure_handlers<br>
            (Trans=0x2b0d03954950, new_code=&lt;value optimized out&gt;,<br>
            branch=&lt;value optimized out&gt;, should_store=0x7fff00703b58,<br>
            should_relay=0x7fff00703b5c, cancel_bitmap=&lt;value<br>
            optimized out&gt;,<br>
            reply=0x796cc0) at t_reply.c:613<br>
            faked_req = {id = 6, first_line = {type = 1, len = 53, u =<br>
            {request = {method = {<br>
            s = 0x2b0d0395bb00 &quot;OPTIONS<br>
            <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;<div><br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len =<br>
            7}, uri = {<br>
            s = 0x2b0d0395bb08 &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;<div><br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r&quot;...,<br>
            len = 35}, version = {<br>
            s = 0x2b0d0395bb2c &quot;SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia:<br>
            SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;<br>
            &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;&quot;..., len = 7}, method_value =<br>
            32}, reply = {version = {<br>
            s = 0x2b0d0395bb00 &quot;OPTIONS<br>
            <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br></div><div>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;<div><br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len =<br>
            7}, status = {<br>
            s = 0x2b0d0395bb08 &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br></div><div>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;<div><div></div><div><br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r&quot;...,<br>
            len = 35}, reason = {<br>
            s = 0x2b0d0395bb2c &quot;SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia:<br>
            SIP/2.0/UDP <a href="http://109.104.88.29:5064" target="_blank">109.104.88.29:5064</a> &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;<br>
            &lt;<a href="http://109.104.88.29:5064" target="_blank">http://109.104.88.29:5064</a>&gt;&quot;..., len = 7}, statuscode =<br>
            32}}}, via1 = 0x2b0d0395bdf8, via2 = 0x2b0d0395bf70,<br>
            headers = 0x2b0d0395bd68, last_header = 0x2b0d0395c530,<br>
            parsed_flag = 18446744073709551615, h_via1 =<br>
            0x2b0d0395bdb0, h_via2 = 0x2b0d0395bf28,<br>
<br>
            callid = 0x2b0d0395c4e8, to = 0x2b0d0395c240, cseq =<br>
            0x2b0d0395c470, from = 0x2b0d0395c168, contact =<br>
            0x2b0d0395c428, maxforwards = 0x2b0d0395c530, route = 0x0,<br>
            record_route = 0x2b0d0395bd68, path = 0x0, content_type = 0x0,<br>
            content_length = 0x2b0d0395c120, authorization = 0x0,<br>
            expires = 0x0, proxy_auth = 0x0, supported = 0x0,<br>
            proxy_require = 0x0, unsupported = 0x0, allow = 0x0, event<br>
            = 0x0, accept = 0x2b0d0395c1b0, accept_language = 0x0,<br>
            organization = 0x0, priority = 0x0, subject = 0x0,<br>
            user_agent = 0x2b0d0395c1f8, content_disposition = 0x0,<br>
            accept_disposition = 0x0, diversion = 0x0, rpid = 0x0,<br>
            refer_to = 0x0, session_expires = 0x0, min_se = 0x0, ppi =<br>
            0x0,<br>
            pai = 0x0, privacy = 0x0, sdp = 0x0, multi = 0x0, eoh =<br>
            0x2b0d0395bd63 &quot;\r\n&quot;, unparsed = 0x2b0d0395bd63 &quot;\r\n&quot;,<br>
            rcv = {src_ip = {af = 2, len = 4, u = {addrl =<br>
            {4113468365, 7}, addr32 = {4113468365, 0, 7, 0}, addr16 =<br>
            {35789,<br>
            62766, 0, 0, 7, 0, 0, 0}, addr =<br>
            &quot;Í.\365\000\000\000\000\a\000\000\000\000\000\000&quot;}},<br>
            dst_ip = {af = 2, len = 4, u = {addrl = {2519632845, 0},<br>
            addr32 = {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0,<br>
            0, 0, 0, 0,<br>
            0}, addr = &quot;Í.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}}, src_port<br>
            = 5060, dst_port = 5060, proto = 1, proto_reserved1 = 0,<br>
            proto_reserved2 = 0, src_su = {s = {sa_family = 2,<br>
            sa_data = &quot;\023\304Í.\365\000\000\000\000\000\000\000&quot;},<br>
            sin = {sin_family = 2, sin_port = 50195, sin_addr =<br>
            {s_addr = 4113468365}, sin_zero =<br>
            &quot;\000\000\000\000\000\000\000&quot;}, sin6 = {sin6_family = 2,<br>
            sin6_port = 50195, sin6_flowinfo = 4113468365, sin6_addr =<br>
            {in6_u = {u6_addr8 = &#39;\000&#39; &lt;repeats 15 times&gt;, u6_addr16<br>
            = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}},<br>
            sin6_scope_id = 0}}, bind_address = 0x795ca0},<br>
            buf = 0x2b0d0395bb00 &quot;OPTIONS<br>
            <a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br></div></div><div>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;<div><br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP 4.2.46.245;branch=z9hG4bK8702.83&quot;..., len =<br>
            613, new_uri = {s = 0x79c4f0<br>
            &quot;<a href="mailto:sip%3A100@internal-sip.mycompany.com" target="_blank">sip:100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a>&gt;<br></div><div>
            &lt;mailto:<a href="mailto:sip%253A100@internal-sip.mycompany.com" target="_blank">sip%3A100@internal-sip.mycompany.com</a><br></div>
            &lt;mailto:<a href="mailto:sip%25253A100@internal-sip.mycompany.com" target="_blank">sip%253A100@internal-sip.mycompany.com</a>&gt;&gt;&quot;, len =<div><div></div><div><br>
            35}, dst_uri = {s = 0x0, len = 0}, parsed_uri_ok = 0,<br>
            parsed_uri = {user = {<br>
            s = 0x2b0d0395bb0c &quot;<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a>&gt;<br>
            &lt;mailto:<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a><br>
            &lt;mailto:<a href="mailto:100@internal-sip.mycompany.com" target="_blank">100@internal-sip.mycompany.com</a>&gt;&gt;<br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia&quot;..., len =<br>
            3}, passwd = {s = 0x0, len = 0}, host = {<br>
            s = 0x2b0d0395bb10 &quot;<a href="http://internal-sip.mycompany.com" target="_blank">internal-sip.mycompany.com</a><br>
            &lt;<a href="http://internal-sip.mycompany.com" target="_blank">http://internal-sip.mycompany.com</a>&gt;<br>
            &lt;<a href="http://internal-sip.mycompany.com" target="_blank">http://internal-sip.mycompany.com</a>&gt;<br>
            SIP/2.0\r\nRecord-Route:<br>
            &lt;sip:4.2.46.245;lr=on;ftag=6364386232656635313363340133363632373934353030&gt;\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia: SI&quot;...,<br>
            len = 27}, port = {s = 0x0, len = 0}, params = {s = 0x0,<br>
            len = 0}, headers = {s = 0x0, len = 0}, port_no = 0, proto<br>
            = 0, type = SIP_URI_T, transport = {s = 0x0, len = 0}, ttl<br>
            = {s = 0x0, len = 0}, user_param = {s = 0x0,<br>
<br>
            len = 0}, maddr = {s = 0x0, len = 0}, method = {s = 0x0,<br>
            len = 0}, lr = {s = 0x0, len = 0}, r2 = {s = 0x0, len =<br>
            0}, transport_val = {s = 0x0, len = 0}, ttl_val = {s =<br>
            0x0, len = 0}, user_param_val = {s = 0x0, len = 0},<br>
            maddr_val = {s = 0x0, len = 0}, method_val = {s = 0x0, len<br>
            = 0}, lr_val = {s = 0x0, len = 0}, r2_val = {s = 0x0, len<br>
            = 0}}, parsed_orig_ruri_ok = 0, parsed_orig_ruri = {user =<br>
            {s = 0x0, len = 0}, passwd = {s = 0x0,<br>
            len = 0}, host = {s = 0x0, len = 0}, port = {s = 0x0, len<br>
            = 0}, params = {s = 0x0, len = 0}, headers = {s = 0x0, len<br>
            = 0}, port_no = 0, proto = 0, type = ERROR_URI_T,<br>
            transport = {s = 0x0, len = 0}, ttl = {s = 0x0,<br>
            len = 0}, user_param = {s = 0x0, len = 0}, maddr = {s =<br>
            0x0, len = 0}, method = {s = 0x0, len = 0}, lr = {s = 0x0,<br>
            len = 0}, r2 = {s = 0x0, len = 0}, transport_val = {s =<br>
            0x0, len = 0}, ttl_val = {s = 0x0, len = 0},<br>
            user_param_val = {s = 0x0, len = 0}, maddr_val = {s = 0x0,<br>
            len = 0}, method_val = {s = 0x0, len = 0}, lr_val = {s =<br>
            0x0, len = 0}, r2_val = {s = 0x0, len = 0}}, add_rm = 0x0,<br>
            body_lumps = 0x0, reply_lump = 0x0,<br>
            add_to_branch_s = &#39;\000&#39; &lt;repeats 57 times&gt;,<br>
            add_to_branch_len = 0, hash_index = 8312, flags = 0,<br>
            msg_flags = 32, set_global_address = {s = 0x0, len = 0},<br>
            set_global_port = {s = 0x0, len = 0}, force_send_socket = 0x0,<br>
            path_vec = {s = 0x0, len = 0}, msg_cb = 0x0}<br>
            __FUNCTION__ = &quot;run_failure_handlers&quot;<br>
            #6 t_should_relay_response (Trans=0x2b0d03954950,<br>
            new_code=&lt;value optimized out&gt;, branch=&lt;value optimized<br>
            out&gt;, should_store=0x7fff00703b58,<br>
            should_relay=0x7fff00703b5c, cancel_bitmap=&lt;value<br>
            optimized out&gt;, reply=0x796cc0)<br>
            at t_reply.c:911<br>
            branch_cnt = 1<br>
            picked_code = &lt;value optimized out&gt;<br>
            inv_through = &lt;value optimized out&gt;<br>
            do_cancel = 0<br>
            __FUNCTION__ = &quot;t_should_relay_response&quot;<br>
            #7 0x00002b0d01979392 in relay_reply (t=0x79c678,<br>
            p_msg=0x796cc0, branch=7354464, msg_status=404,<br>
            cancel_bitmap=0x79d8b0) at t_reply.c:1125<br>
            relay = &lt;value optimized out&gt;<br>
<br>
            l = 0x79d8b0save_clone = &lt;value optimized out&gt;<br>
            buf = &lt;value optimized out&gt;<br>
            res_len = 0<br>
            relayed_code = 404<br>
            relayed_msg = &lt;value optimized out&gt;<br>
            bm = {to_tag_val = {s = 0x7fff00703c3c &quot;&quot;, len = -1}}<br>
            totag_retr = &lt;value optimized out&gt;<br>
            reply_status = RPS_ERROR<br>
            uas_rb = &lt;value optimized out&gt;<br>
            cb_s = {s = 0x796cc0 &quot;\005&quot;, len = 7704384}<br>
            text = {s = 0x500000000796cc0 &lt;Address 0x500000000796cc0<br>
            out of bounds&gt;, len = 528}<br>
            __FUNCTION__ = &quot;relay_reply&quot;<br>
            #8 0x00002b0d0197a980 in reply_received (p_msg=0x796cc0)<br>
            at t_reply.c:1494<br>
            msg_status = 404<br>
            branch = 7354464<br>
            reply_status = &lt;value optimized out&gt;<br>
            timer = &lt;value optimized out&gt;<br>
            cancel_bitmap = 0<br>
            uac = 0x2b0d03954b28<br>
            t = 0x2b0d03954950<br>
            backup_list = 0x0<br>
            __FUNCTION__ = &quot;reply_received&quot;<br>
            #9 0x0000000000421e98 in forward_reply (msg=0x796cc0) at<br>
            forward.c:561<br>
            new_buf = &lt;value optimized out&gt;<br>
            to = &lt;value optimized out&gt;<br>
            new_len = &lt;value optimized out&gt;<br>
            mod = 0x7849f8<br>
            proto = &lt;value optimized out&gt;<br>
            id = &lt;value optimized out&gt;<br>
            send_sock = &lt;value optimized out&gt;<br>
            len = &lt;value optimized out&gt;<br>
            __FUNCTION__ = &quot;forward_reply&quot;<br>
            #10 0x00000000004570c2 in receive_msg (<br>
            buf=0x758f40 &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP<br>
            4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia:<br>
            SIP/2.0/UDP 109.104.88.29:5064;recei&quot;...,<br>
            len=528, rcv_info=0x7fff00703d20) at receive.c:200<br>
            msg = 0x79c678<br>
            __FUNCTION__ = &quot;receive_msg&quot;<br>
            #11 0x000000000049be14 in udp_rcv_loop () at udp_server.c:492<br>
            len = 528<br>
            tmp = 0x13c4 &lt;Address 0x13c4 out of bounds&gt;<br>
            from = &lt;value optimized out&gt;<br>
            fromlen = 16<br>
            ri = {src_ip = {af = 2, len = 4, u = {addrl = {3526265805,<br>
            6}, addr32 = {3526265805, 0, 6, 0}, addr16 = {35789,<br>
            53806, 0, 0, 6, 0, 0, 0}, addr =<br>
            &quot;Í.\322\000\000\000\000\006\000\000\000\000\000\000&quot;}},<br>
            dst_ip = {af = 2,<br>
            len = 4, u = {addrl = {2519632845, 0}, addr32 =<br>
            {2519632845, 0, 0, 0}, addr16 = {35789, 38446, 0, 0, 0, 0,<br>
            0, 0}, addr = &quot;Í.\226&quot;, &#39;\000&#39; &lt;repeats 11 times&gt;}},<br>
            src_port = 5060, dst_port = 5060, proto = 1,<br>
            proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s =<br>
            {sa_family = 2, sa_data =<br>
            &quot;\023\304Í.\322\000\000\000\000\000\000\000&quot;}, sin =<br>
            {sin_family = 2, sin_port = 50195, sin_addr = {s_addr =<br>
            3526265805},<br>
            sin_zero = &quot;\000\000\000\000\000\000\000&quot;}, sin6 =<br>
            {sin6_family = 2, sin6_port = 50195, sin6_flowinfo =<br>
            3526265805, sin6_addr = {in6_u = {u6_addr8 = &#39;\000&#39;<br>
            &lt;repeats 15 times&gt;, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},<br>
            u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}},<br>
            bind_address = 0x795ca0}<br>
            p = 0x0<br>
            buf = &quot;SIP/2.0 404 Not Found\r\nVia: SIP/2.0/UDP<br>
            4.2.46.150;branch=z9hG4bK8702.d1287257.0;rport=5060\r\nVia:<br>
            SIP/2.0/UDP<br>
            4.2.46.245;branch=z9hG4bK8702.83cfa2a.0\r\nVia:<br>
            SIP/2.0/UDP 109.104.88.29:5064;recei&quot;...<br>
            __FUNCTION__ = &quot;udp_rcv_loop&quot;<br>
            #12 0x000000000042a65d in main_loop (argc=3, argv=&lt;value<br>
            optimized out&gt;) at main.c:818<br>
            i = 1<br>
            pid = &lt;value optimized out&gt;<br>
            si = 0x0<br>
            startup_done = 0x0<br>
            chd_rank = 6<br>
            __FUNCTION__ = &quot;main_loop&quot;<br>
            #13 main (argc=3, argv=&lt;value optimized out&gt;) at main.c:1388<br>
            cfg_log_stderr = &lt;value optimized out&gt;<br>
            cfg_stream = 0xf8d0010<br>
            c = &lt;value optimized out&gt;<br>
            r = &lt;value optimized out&gt;<br>
<br>
            old = 0x0<br>
            n = &lt;value optimized out&gt;<br>
            len = 1<br>
            i = 0<br>
            __FUNCTION__ = &quot;backup&quot;<br>
            ------------------------------------------------------------------------<br>
<br>
            _______________________________________________<br>
            Users mailing list<br></div></div>
            <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a> &lt;mailto:<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>&gt;<div><br>

            <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br>
<br>
<br>
        --         Bogdan-Andrei Iancu<br>
        OpenSIPS Bootcamp<br>
        15 - 19 November 2010, Edison, New Jersey, USA<br></div>
        <a href="http://www.voice-system.ro" target="_blank">www.voice-system.ro</a> &lt;<a href="http://www.voice-system.ro" target="_blank">http://www.voice-system.ro</a>&gt;<br>
<br>
<br>
        _______________________________________________<br>
        Users mailing list<br>
        <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a> &lt;mailto:<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>&gt;<div><br>
        <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br>
<br>
<br>
------------------------------------------------------------------------<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
  <br>
</div></blockquote><font color="#888888">
<br>
<br>
-- <br>
Bogdan-Andrei Iancu<br>
OpenSIPS Event - expo, conf, social, bootcamp<br>
2 - 4 February 2011, ITExpo, Miami,  USA</font><div><div></div><div><br>
<a href="http://www.voice-system.ro" target="_blank">www.voice-system.ro</a><br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br>