<div dir="ltr"><div class="gmail_extra">Hello Răzvan, sorry for the delay, but I&#39;ve received you email today. I will ping you tomorrow, I&#39;m on GMT-3, let&#39;s see if we can be available at the same time...</div><div class="gmail_extra">Thanks</div><div class="gmail_extra">
<br><div class="gmail_quote">On Wed, May 20, 2015 at 4:29 AM, Răzvan Crainea <span dir="ltr">&lt;<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
  
    
  
  <div text="#000000" bgcolor="#FFFFFF">
    <tt>Hi, Federico!<br>
      <br>
      Is there any chance you could ping pe on IRC, freenode, #opensips
      so we can debug this further?<br>
      <br>
      Best regards,<br>
    </tt><span class="">
    <pre cols="72">Răzvan Crainea
OpenSIPS Solutions
<a href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
    </span><div><div class="h5"><div>On 05/15/2015 04:12 PM, Federico Edorna
      wrote:<br>
    </div>
    <blockquote type="cite">
      <div dir="ltr">
        <div>Sure, you have 3 different cores pasted on the following
          urls:</div>
        <div><br>
        </div>
        <div>
          <div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/xZ2zqJ0F" target="_blank">http://pastebin.com/xZ2zqJ0F</a></span><br>
          </div>
          <div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/8DWhsMfK" target="_blank">http://pastebin.com/8DWhsMfK</a></span><br>
          </div>
          <div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/9ERCD3mZ" target="_blank">http://pastebin.com/9ERCD3mZ</a></span></div>
          <div class="gmail_extra"><br clear="all">
            <div>
              <div>
                <div dir="ltr">
                  <div><br>
                  </div>
                  <div>The opensips logs for those cores are pasted
                    below in my email (Apr 6, 2015 at 4:46 PM)</div>
                  <div><br>
                  </div>
                  <div>Thanks!</div>
                  <div><br>
                  </div>
                  <div><br>
                  </div>
                </div>
              </div>
            </div>
            <div class="gmail_quote">On Fri, May 15, 2015 at 7:14 AM,
              Răzvan Crainea <span dir="ltr">&lt;<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>&gt;</span>
              wrote:<br>
              <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                <div text="#000000" bgcolor="#FFFFFF"> <tt>Hi,
                    Federico!<br>
                    <br>
                    Can you attach the output of the core file on
                    pastebin?<br>
                    <br>
                    Best regards,<br>
                  </tt><span>
                    <pre cols="72">Răzvan Crainea
OpenSIPS Solutions
<a href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                  </span>
                  <div>
                    <div>
                      <div>On 05/08/2015 04:51 PM, Federico Edorna
                        wrote:<br>
                      </div>
                      <blockquote type="cite">
                        <div dir="ltr">Hi Răzvan, It was happening at
                          least once a day. It started to happen when we
                          reach ~80 registered terminals, not a big
                          load. Now I&#39;m using the event_rabbitmq module
                          with 400 terminals and it&#39;s working fine.
                          <div><br>
                          </div>
                          <div>The event is a custom one, I called
                            &quot;E_REGISTERED&quot;, it&#39;s just to notify an
                            external process that a particular terminal
                            has registered, this is part of the
                            configuration that crashes:
                            <div>
                              <div><br>
                              </div>
                              <div>
                                <div><i>startup_route {</i></div>
                                <div><i>       
                                    subscribe_event(&quot;E_REGISTERED&quot;,
                                    &quot;xmlrpc:10.10.11.2:10080:OSEvent&quot;);</i></div>
                                <div><i>}</i></div>
                                <div><i>...</i></div>
                                <div><i>...</i></div>
                                <div><i>route {</i></div>
                                <div><i>...</i></div>
                                <div><i>...</i></div>
                                <div><i>        if
                                    (is_method(&quot;REGISTER&quot;)) {<br>
                                  </i></div>
                                <div>
                                  <div><i>...</i></div>
                                  <div><i>...</i></div>
                                  <div><i>               
                                      $avp(attr-name) = &quot;username&quot;;<br>
                                    </i></div>
                                  <div><i>                $avp(attr-val)
                                      = $tU;</i></div>
                                  <div><i>               
                                      $avp(attr-name) = &quot;domain&quot;;</i></div>
                                  <div><i>                $avp(attr-val)
                                      = $td;</i></div>
                                  <div><i>               
                                      raise_event(&quot;E_REGISTERED&quot;,
                                      $avp(attr-name), $avp(attr-val));</i></div>
                                </div>
                                <div><i>...</i></div>
                                <div><i>...</i></div>
                                <div><i>}</i></div>
                                <div class="gmail_extra">
                                  <div>
                                    <div>
                                      <div dir="ltr"><br>
                                      </div>
                                    </div>
                                  </div>
                                  <div class="gmail_extra">Another
                                    thing: when I compiled
                                    with DBG_QM_MALLOC instead of
                                    F_MALLOC to debug, I didn&#39;t have any
                                    crashes for about 5 days. Maybe I
                                    should have waited more time to
                                    confirm, but it seems that the first
                                    memory manager solved the issue.</div>
                                  <div class="gmail_extra"><br>
                                  </div>
                                  <div class="gmail_extra">Regarding to
                                    the core files, it seems than some
                                    module (even_xmlrpc for me..) it&#39;s
                                    freeing memory that it should not.
                                    After this issue I realized that the
                                    module was in beta, so I moved to
                                    the rabbitmq</div>
                                  <div class="gmail_extra"><br>
                                  </div>
                                  <div class="gmail_extra">Thanks for
                                    your reply</div>
                                  <div class="gmail_extra">Federico</div>
                                  <div class="gmail_extra"><br>
                                  </div>
                                  <br>
                                  <div class="gmail_quote">On Fri, May
                                    8, 2015 at 7:47 AM, Răzvan Crainea <span dir="ltr">&lt;<a href="mailto:razvan@opensips.org" target="_blank">razvan@opensips.org</a>&gt;</span>
                                    wrote:<br>
                                    <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                                      <div text="#000000" bgcolor="#FFFFFF"> <tt>Hi,
                                          Federico!<br>
                                          <br>
                                          Is this easily replicating, or
                                          it happens once in a while?
                                          Also, what events are you
                                          raising?<br>
                                          <br>
                                          Best regards,<br>
                                        </tt>
                                        <pre cols="72">Răzvan Crainea
OpenSIPS Solutions
<a href="http://www.opensips-solutions.com" target="_blank">www.opensips-solutions.com</a></pre>
                                        <div>
                                          <div>
                                            <div>On 04/24/2015 05:44 PM,
                                              Federico Edorna wrote:<br>
                                            </div>
                                          </div>
                                        </div>
                                        <blockquote type="cite">
                                          <div>
                                            <div>
                                              <div dir="ltr">
                                                <div class="gmail_extra">Just
                                                  in case somebody deal
                                                  with the same issue,
                                                  the problem seems to
                                                  be event_xmlrpc
                                                  module. I tried with
                                                  the event_datagram to
                                                  notify the external
                                                  process and I got no
                                                  more crashes for a
                                                  couple of weeks.</div>
                                                <div class="gmail_extra">Now
                                                  I&#39;m using event_rabbit
                                                  module instead of
                                                  datagram without
                                                  problems for a couple
                                                  of days.</div>
                                                <div class="gmail_extra"><br>
                                                </div>
                                                <div class="gmail_extra">
                                                  <br>
                                                  <div class="gmail_quote">On
                                                    Mon, Apr 6, 2015 at
                                                    4:46 PM, Federico
                                                    Edorna <span dir="ltr">&lt;<a href="mailto:fedorna@anura.com.ar" target="_blank">fedorna@anura.com.ar</a>&gt;</span>
                                                    wrote:<br>
                                                    <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                                                      <div dir="ltr">
                                                        <div class="gmail_extra"><span><span style="font-size:12.8000001907349px">Hello, I&#39;m getting core dumps in
                                                          version
                                                          1.11.3.</span></span>
                                                          <div><span style="font-size:12.8000001907349px">Unlike


                                                          other opensips
                                                          we are running
                                                          without
                                                          problems,
                                                          we&#39;re using
                                                          some extra
                                                          modules in
                                                          this config
                                                          because
                                                          opensips needs
                                                          to notify an
                                                          external
                                                          process (via
                                                          event_xmlrpc)
                                                          when a
                                                          terminal
                                                          registers, and
                                                          that external
                                                          process
                                                          afterwards
                                                          sends opensips
                                                          (via
                                                          mi_datagram/t_uac_dlg)
                                                          a MWI NOTIFY
                                                          for the
                                                          terminal.</span>
                                                          <div><br>
                                                          <div style="font-size:12.8000001907349px">I&#39;m


                                                          pasting 3
                                                          backtraces
                                                          (commit
                                                          cbaf569, but
                                                          it happened
                                                          for previous
                                                          commits too)</div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/xZ2zqJ0F" target="_blank">http://pastebin.com/xZ2zqJ0F</a></span><br>
                                                          </div>
                                                          <div><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/8DWhsMfK" target="_blank">http://pastebin.com/8DWhsMfK</a></span><br>
                                                          </div>
                                                          <div><span style="font-size:12.8000001907349px"><a href="http://pastebin.com/9ERCD3mZ" target="_blank">http://pastebin.com/9ERCD3mZ</a></span><br>
                                                          </div>
                                                          <div>
                                                          <div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">This


                                                          is what syslog
                                                          shows:</div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">
                                                          <div>2015-04-03T13:45:16.228227-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24272]:
                                                          CRITICAL:core:recv_all:

                                                          1st recv on 36
                                                          failed:
                                                          Connection
                                                          reset by peer</div>
                                                          <div>2015-04-03T13:45:16.228249-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24272]:
                                                          CRITICAL:core:handle_tcp_child:

                                                          read from tcp
                                                          child 0 (pid
                                                          24240, no 0)
                                                          Connection
                                                          reset by</div>
                                                          <div> peer
                                                          [104]</div>
                                                          <div>2015-04-03T13:45:16.228260-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24272]:
                                                          CRITICAL:core:receive_fd:

                                                          EOF on 38</div>
                                                          <div>2015-04-03T13:45:16.250712-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24214]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          child process
                                                          24240 exited
                                                          by a signal 11</div>
                                                          <div>2015-04-03T13:45:16.250727-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24214]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          core was
                                                          generated</div>
                                                          <div>2015-04-03T13:45:16.250735-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24214]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          terminating
                                                          due to SIGCHLD</div>
                                                          <div>2015-04-03T13:45:16.250800-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[24270]:
                                                          <a>INFO:core:sig_usr</a>:
                                                          signal 15
                                                          received</div>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">----</div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">
                                                          <div>2015-04-03T13:54:48.179260-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21747]:
                                                          CRITICAL:core:recv_all:

                                                          1st recv on 36
                                                          failed:
                                                          Connection
                                                          reset by peer</div>
                                                          <div>2015-04-03T13:54:48.179289-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21747]:
                                                          CRITICAL:core:handle_tcp_child:

                                                          read from tcp
                                                          child 0 (pid
                                                          21715, no 0)
                                                          Connection
                                                          reset by</div>
                                                          <div> peer
                                                          [104]</div>
                                                          <div>2015-04-03T13:54:48.179307-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21747]:
                                                          CRITICAL:core:receive_fd:

                                                          EOF on 38</div>
                                                          <div>2015-04-03T13:54:48.179373-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21688]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          child process
                                                          21715 exited
                                                          by a signal 11</div>
                                                          <div>2015-04-03T13:54:48.179388-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21688]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          core was
                                                          generated</div>
                                                          <div>2015-04-03T13:54:48.179402-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21688]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          terminating
                                                          due to SIGCHLD</div>
                                                          <div>2015-04-03T13:54:48.179417-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21746]:
                                                          <a>INFO:core:sig_usr</a>:
                                                          signal 15
                                                          received</div>
                                                          <div>2015-04-03T13:54:48.179426-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21745]:
                                                          <a>INFO:core:sig_usr</a>:
                                                          signal 15
                                                          received</div>
                                                          <div>2015-04-03T13:54:48.179435-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[21743]:
                                                          <a>INFO:core:sig_usr</a>:
                                                          signal 15
                                                          received</div>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">----</div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">
                                                          <div>2015-04-03T14:44:01.064875-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31736]:
                                                          CRITICAL:core:recv_all:

                                                          1st recv on 36
                                                          failed:
                                                          Connection
                                                          reset by peer</div>
                                                          <div>2015-04-03T14:44:01.064898-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31736]:
                                                          CRITICAL:core:handle_tcp_child:

                                                          read from tcp
                                                          child 0 (pid
                                                          31704, no 0)
                                                          Connection
                                                          reset by</div>
                                                          <div> peer
                                                          [104]</div>
                                                          <div>2015-04-03T14:44:01.064922-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31736]:
                                                          CRITICAL:core:receive_fd:

                                                          EOF on 38</div>
                                                          <div>2015-04-03T14:44:01.064943-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31678]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          child process
                                                          31704 exited
                                                          by a signal 11</div>
                                                          <div>2015-04-03T14:44:01.064954-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31678]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          core was
                                                          generated</div>
                                                          <div>2015-04-03T14:44:01.064963-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31678]:
                                                          <a>INFO:core:handle_sigs</a>:
                                                          terminating
                                                          due to SIGCHLD</div>
                                                          <div>2015-04-03T14:44:01.066539-03:00


                                                          bermeja
                                                          /home/gc/local/opensips/sbin/opensips[31736]:
                                                          <a>INFO:core:sig_usr</a>:
                                                          signal 15
                                                          received</div>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px"><br>
                                                          </div>
                                                          <div style="font-size:12.8000001907349px">Thanks


                                                          in advance</div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          <span><font color="#888888">
                                                          <div style="font-size:12.8000001907349px">Federico</div>
                                                          </font></span></div>
                                                        </div>
                                                      </div>
                                                    </blockquote>
                                                  </div>
                                                  <br>
                                                </div>
                                              </div>
                                              <br>
                                              <fieldset></fieldset>
                                              <br>
                                            </div>
                                          </div>
                                          <pre>_______________________________________________
Users mailing list
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a>
</pre>
                                        </blockquote>
                                        <br>
                                      </div>
                                      <br>
_______________________________________________<br>
                                      Users mailing list<br>
                                      <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
                                      <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
                                      <br>
                                    </blockquote>
                                  </div>
                                  <br>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                        <br>
                        <fieldset></fieldset>
                        <br>
                        <pre>_______________________________________________
Users mailing list
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a>
</pre>
                      </blockquote>
                      <br>
                    </div>
                  </div>
                </div>
                <br>
                _______________________________________________<br>
                Users mailing list<br>
                <a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
                <a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
                <br>
              </blockquote>
            </div>
            <br>
          </div>
        </div>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      <pre>_______________________________________________
Users mailing list
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a>
</pre>
    </blockquote>
    <br>
  </div></div></div>

<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>