<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    Hi Tito,<br>
    <br>
    Are you sure there is no error in your local installation ? Starting
    with 2.2 there is no DBG_QM_MALLOC option as per your snapshot. Be
    sure you do not have mixture between different OpenSIPS versions.<br>
    <br>
    Also, in this link :
    <a class="moz-txt-link-freetext" href="http://www.opensips.org/Documentation/TroubleShooting-OutOfMem">http://www.opensips.org/Documentation/TroubleShooting-OutOfMem</a>, in
    "How to handle it" section, you have special paragraph for &gt;=
    "2.2" .<br>
    <br>
    Regards,<br>
    <pre class="moz-signature" cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a class="moz-txt-link-freetext" href="http://www.opensips-solutions.com">http://www.opensips-solutions.com</a></pre>
    <div class="moz-cite-prefix">On 27.06.2016 21:29, Tito Cumpen wrote:<br>
    </div>
    <blockquote
cite="mid:CANZPVB4nD65a2r6XQonbN-Kf_k46DiksY+a3TRk0J2Zaf6J+Hw@mail.gmail.com"
      type="cite">
      <div dir="ltr">Bogdan,
        <div><br>
        </div>
        <div><br>
        </div>
        <div>The QM_malloc option specified in this document does not
          exist.<img src="cid:part1.07040307.00010602@opensips.org"
            alt="Inline image 1" width="323" height="402"></div>
        <div>Was it replaced with</div>
        <div><br>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Tue, May 3, 2016 at 1:11 PM,
          Bogdan-Andrei Iancu <span dir="ltr">&lt;<a
              moz-do-not-send="true" href="mailto:bogdan@opensips.org"
              target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:bogdan@opensips.org">bogdan@opensips.org</a></a>&gt;</span> wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> <tt>Hi Tito,<br>
                <br>
                You should have reported it sooner:)<br>
                Could you compile in the memory debugger (as the
                backtrace you posted here points to a memory
                corruption). Use DBG_MALLOC flag in combination with F_
                / HP_ / QM_ memeory managers :<br>
                    <a moz-do-not-send="true"
                  href="http://www.opensips.org/Documentation/TroubleShooting-OutOfMem"
                  target="_blank">http://www.opensips.org/Documentation/TroubleShooting-OutOfMem</a><br>
                <br>
                Regards,<br>
              </tt>
              <pre cols="72">Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
<a moz-do-not-send="true" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.com</a></pre>
              <div>
                <div class="h5">
                  <div>On 03.05.2016 20:00, Tito Cumpen wrote:<br>
                  </div>
                </div>
              </div>
              <blockquote type="cite">
                <div>
                  <div class="h5">
                    <div dir="ltr">Group,
                      <div><br>
                      </div>
                      <div><br>
                      </div>
                      <div>I get about two nightly crashes in the latest
                        opensips head this has been happening
                        consistently for about a week and half now. All
                        crashes are identical to:</div>
                      <div>
                        <p><span>Using host libthread_db library
                            "/lib64/libthread_db.so.1".</span></p>
                        <p><span>Core was generated by `/sbin/opensips
                            -P /var/run/opensips.pid -u opensips -g
                            opensips -M 1024 -f /etc'.</span></p>
                        <p><span>Program terminated with signal 11,
                            Segmentation fault.</span></p>
                        <p><span>#0  0x0000000000512512 in
                            fm_remove_free (n=0x7f384a06b680,
                            qm=0x7f3849fc8010) at mem/f_malloc.c:187</span></p>
                        <p><span>187<span> </span><span> </span>*pf=n-&gt;u.nxt_free;</span></p>
                        <p><span>Missing separate debuginfos, use:
                            debuginfo-install
                            cyrus-sasl-lib-2.1.26-20.el7_2.x86_64
                            glibc-2.17-106.el7_2.4.x86_64
                            gmp-6.0.0-12.el7_1.x86_64
                            gnutls-3.3.8-14.el7_2.x86_64
                            keyutils-libs-1.5.8-3.el7.x86_64
                            krb5-libs-1.13.2-12.el7_2.x86_64
                            libcom_err-1.42.9-7.el7.x86_64
                            libcurl-7.29.0-25.el7.centos.x86_64
                            libffi-3.0.13-16.el7.x86_64
                            libgcc-4.8.5-4.el7.x86_64
                            libgcrypt-1.5.3-12.el7_1.1.x86_64
                            libgpg-error-1.12-3.el7.x86_64
                            libidn-1.28-4.el7.x86_64
                            libmicrohttpd-0.9.33-2.el7.x86_64
                            librabbitmq-0.5.2-1.el7.x86_64
                            libselinux-2.2.2-6.el7.x86_64
                            libssh2-1.4.3-10.el7_2.1.x86_64
                            libstdc++-4.8.5-4.el7.x86_64
                            libtasn1-3.8-2.el7.x86_64
                            nettle-2.7.1-4.el7.x86_64
                            nspr-4.11.0-1.el7_2.x86_64
                            nss-3.21.0-9.el7_2.x86_64
                            nss-softokn-freebl-3.16.2.3-14.2.el7_2.x86_64
                            nss-util-3.21.0-2.2.el7_2.x86_64
                            openldap-2.4.40-9.el7_2.x86_64
                            openssl-libs-1.0.1e-51.el7_2.4.x86_64
                            p11-kit-0.20.7-3.el7.x86_64
                            pcre-8.32-15.el7.x86_64
                            trousers-0.3.13-1.el7.x86_64
                            xz-libs-5.1.2-12alpha.el7.x86_64
                            zlib-1.2.7-15.el7.x86_64</span></p>
                        <p><span>(gdb) bt full</span></p>
                        <p><span>#0  0x0000000000512512 in
                            fm_remove_free (n=0x7f384a06b680,
                            qm=0x7f3849fc8010) at mem/f_malloc.c:187</span></p>
                        <p><span>        pf = 0x0</span></p>
                        <p><span>        hash = 2051</span></p>
                        <p><span>#1  fm_malloc (qm=0x7f3849fc8010,
                            size=size@entry=65592) at mem/f_malloc.c:415</span></p>
                        <p><span>        frag = 0x7f384a06b680</span></p>
                        <p><span>        n = &lt;optimized out&gt;</span></p>
                        <p><span>        hash = 2051</span></p>
                        <p><span>        __FUNCTION__ = "fm_malloc"</span></p>
                        <p><span>#2  0x00007f383e018652 in
                            tcp_handle_req
                            (_max_msg_chunks=&lt;optimized out&gt;,
                            con=&lt;optimized out&gt;, req=&lt;optimized
                            out&gt;) at
                            ../../net/proto_tcp/tcp_common.h:459</span></p>
                        <p><span>        local_rcv = {src_ip = {af =
                            760673648, len = 32766, u = {addrl = {16,
                            20}, addr32 = {16, 0, 20, 0}, addr16 = {16,
                            0, 0, 0, 20, 0, 0, 0}, addr =
                            "\020\000\000\000\000\000\000\000\024\000\000\000\000\000\000"}},
                            dst_ip = {af = 1, len = 1, u = {addrl = {</span></p>
                        <p><span>                139878494896234,
                            5869476}, addr32 = {106, 32568, 5869476, 0},
                            addr16 = {106, 0, 32568, 0, 36772, 89, 0,
                            0}, addr =
                            "j\000\000\000\070\177\000\000\244\217Y\000\000\000\000"}},
                            src_port = 0, dst_port = 0, proto = 0,
                            proto_reserved1 = 0, </span></p>
                        <p><span>          proto_reserved2 = 0, src_su =
                            {s = {sa_family = 62576, sa_data =
                            "V-\376\177\000\000\001\000\000\000\000\000\000"},
                            sin = {sin_family = 62576, sin_port = 11606,
                            sin_addr = {s_addr = 32766}, sin_zero =
                            "\001\000\000\000\000\000\000"}, sin6 = {</span></p>
                        <p><span>              sin6_family = 62576,
                            sin6_port = 11606, sin6_flowinfo = 32766,
                            sin6_addr = {__in6_u = {__u6_addr8 =
                            "\001\000\000\000\000\000\000\000\200\364V-\376\177\000",
                            __u6_addr16 = {1, 0, 0, 0, 62592, 11606,
                            32766, 0}, __u6_addr32 = {1, 0, 760673408,
                            32766}}}, </span></p>
                        <p><span>              sin6_scope_id = 24}},
                            bind_address = 0x4a03e63000000001}</span></p>
                        <p><span>        msg_buf = &lt;optimized out&gt;</span></p>
                        <p><span>        msg_len = &lt;optimized out&gt;</span></p>
                        <p><span>        c = &lt;optimized out&gt;</span></p>
                        <p><span>        size = &lt;optimized out&gt;</span></p>
                        <p><span>#3  tls_read_req (con=0x7f38481398c0,
                            bytes_read=0x7ffe2d56f550) at
                            proto_tls.c:441</span></p>
                        <p><span>        bytes = &lt;optimized out&gt;</span></p>
                        <p><span>        total_bytes = 0</span></p>
                        <p><span>        req = &lt;optimized out&gt;</span></p>
                        <p><span>        __FUNCTION__ = "tls_read_req"</span></p>
                        <p><span>#4  0x000000000059c478 in handle_io
                            (fm=fm@entry=0x7f384a03e630,
                            idx=idx@entry=3,
                            event_type=event_type@entry=1) at
                            net/net_tcp_proc.c:205</span></p>
                        <p><span>        ret = 0</span></p>
                        <p><span>        n = &lt;optimized out&gt;</span></p>
                        <p><span>        con = 0x7f38481398c0</span></p>
                        <p><span>        s = 106</span></p>
                        <p><span>        rw = &lt;optimized out&gt;</span></p>
                        <p><span>        resp = &lt;optimized out&gt;</span></p>
                        <p><span>        response = {139879704139968, 1}</span></p>
                        <p><span>        __FUNCTION__ = "handle_io"</span></p>
                        <p><span>#5  0x000000000059daee in
                            io_wait_loop_epoll (h=&lt;optimized out&gt;,
                            t=&lt;optimized out&gt;,
                            repeat=&lt;optimized out&gt;) at
                            net/../io_wait_loop.h:221</span></p>
                        <p><span>        ret = &lt;optimized out&gt;</span></p>
                        <p><span>        e = &lt;optimized out&gt;</span></p>
                        <p><span>        n = 1</span></p>
                        <p><span>        r = 4</span></p>
                        <p><span>#6  tcp_worker_proc
                            (unix_sock=&lt;optimized out&gt;) at
                            net/net_tcp_proc.c:312</span></p>
                        <p><span>        __FUNCTION__ =
                            "tcp_worker_proc"</span></p>
                        <p><span>#7  0x00000000005a80c3 in
                            tcp_start_processes
                            (chd_rank=chd_rank@entry=0x841360
                            &lt;chd_rank.11009&gt;,
                            startup_done=startup_done@entry=0x7f3848136888)
                            at net/net_tcp.c:1758</span></p>
                        <p><span>        r = 2</span></p>
                        <p><span>        reader_fd = {98, 100}</span></p>
                        <p><span>        pid = 0</span></p>
                        <p><span>        load_p = 0x7f38481374e8</span></p>
                        <p><span>        __FUNCTION__ =
                            "tcp_start_processes"</span></p>
                        <p><span>#8  0x0000000000419f05 in main_loop ()
                            at main.c:677</span></p>
                        <p><span>        startup_done = 0x7f3848136888</span></p>
                        <p><span>        chd_rank = 15</span></p>
                        <p><span>#9  main (argc=&lt;optimized out&gt;,
                            argv=&lt;optimized out&gt;) at main.c:1258</span></p>
                        <p><span>        cfg_stream = &lt;optimized
                            out&gt;</span></p>
                        <p><span>        c = &lt;optimized out&gt;</span></p>
                        <p><span>        r = &lt;optimized out&gt;</span></p>
                        <p><span>        tmp = 0x7ffe2d56ff65 ""</span></p>
                        <p><span>        tmp_len = &lt;optimized out&gt;</span></p>
                        <p><span>        port = &lt;optimized out&gt;</span></p>
                        <p><span>        proto = &lt;optimized out&gt;</span></p>
                        <p><span>        protos_no = &lt;optimized
                            out&gt;</span></p>
                        <p><span>        options = 0x5daf00
                            "f:cCm:M:b:l:n:N:rRvdDFETSVhw:t:u:g:P:G:W:o:"</span></p>
                        <p><span>        ret = -1</span></p>
                        <p><span>        seed = 3936233749</span></p>
                        <p><span>        rfd = &lt;optimized out&gt;</span></p>
                        <p><span>        __FUNCTION__ = "main"</span></p>
                        <p><span><br>
                          </span></p>
                        <p><span><br>
                          </span></p>
                        <p><span>Please advise if anything else is
                            needed.</span></p>
                      </div>
                    </div>
                    <br>
                    <fieldset></fieldset>
                    <br>
                  </div>
                </div>
                <pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a moz-do-not-send="true" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a>
</pre>
              </blockquote>
              <br>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
  </body>
</html>