Here's a piece of information that may be relevant....<div><br></div><div>So I restart opensips completely..</div><div><br></div><div>Then I do a:</div>
<div>opensipsctl cr reload</div><div><br></div><div>works fine</div><div><br></div><div>then I do:</div><div>opensipsctl fifo dlg_list</div><div><br class="webkit-block-placeholder"></div><div>and I get:</div><div>500 command 'dlg_list' failed</div>
<div><br class="webkit-block-placeholder"></div><div>Next I try:</div><div>opensipsctl cr reload</div><div><br class="webkit-block-placeholder"></div><div>and I get:</div><div>500 failed to re-built tree, see log</div><div>
<br class="webkit-block-placeholder"></div><div>And then opensipsctl cr reload never works again unless I restart the process..</div><div><br class="webkit-block-placeholder"></div><div>The log message, as I mentioned in my last email shows:</div>
<div><div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:db_mysql:db_mysql_convert_rows: no private memory left </div><div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:db_mysql:db_mysql_convert_result: error while converting rows </div>
<div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:db_mysql:db_mysql_store_result: error while converting result </div><div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:core:db_do_query: error while storing result</div>
<div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:carrierroute:load_route_data: Failed to query database. </div><div>Mar 20 12:52:21 sip1 /usr/local/sbin/opensips[23232]: ERROR:carrierroute:prepare_route_tree: could not load routing data </div>
<div><br class="webkit-block-placeholder"></div><div>Help?</div><div>Thanks,</div><div>Brett</div><div><br class="webkit-block-placeholder"></div></div><div><br><div class="gmail_quote">
On Fri, Mar 20, 2009 at 11:49 AM, Brett Nemeroff <span dir="ltr"><<a href="mailto:brett@nemeroff.com" target="_blank">brett@nemeroff.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Bogdan,<div>Now I get the following even on a:</div><div>opensipsctl cr reload</div><div><br></div><div><div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:db_mysql:db_mysql_convert_rows: no private memory left </div>
<div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:db_mysql:db_mysql_convert_result: error while converting rows </div><div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:db_mysql:db_mysql_store_result: error while converting result </div>
<div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:core:db_do_query: error while storing result</div><div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:carrierroute:load_route_data: Failed to query database. </div>
<div>Mar 20 12:47:35 sip1 /usr/local/sbin/opensips[6115]: ERROR:carrierroute:prepare_route_tree: could not load routing data </div><div><br></div><div>I'm pretty concerned about this.. not sure why it all of a sudden began to happen. Server otherwise looks healthy?</div>
<div><br></div><div>Any ideas?</div><div><br></div><font color="#888888"><div>-Brett</div></font><div><div></div><div><div><br></div><div><br><div class="gmail_quote">On Thu, Mar 19, 2009 at 8:27 PM, Brett Nemeroff <span dir="ltr"><<a href="mailto:brett@nemeroff.com" target="_blank">brett@nemeroff.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hey All,<div>I'm using 1.4.4-notls with the carrierroute module. Everything was working fine with about 6 routes loaded. Then I loaded an addition 120 routes and now when I execute:</div>
<div>opensipsctl fifo dlg_list</div>
<div><br></div><div>I get:</div><div><div>[root@sip1 opensips-1.4.4-notls]# opensipsctl fifo dlg_list</div><div>500 command 'dlg_list' failed</div><div>[root@sip1 opensips-1.4.4-notls]# </div><div>Mar 19 21:23:44 sip1 /usr/local/sbin/opensips[6115]: ERROR:core:create_mi_node: no more pkg mem </div>
<div>Mar 19 21:23:44 sip1 /usr/local/sbin/opensips[6115]: ERROR:dialog:internal_mi_print_dlg: failed to add node </div><div>Mar 19 21:23:44 sip1 /usr/local/sbin/opensips[6115]: ERROR:dialog:internal_mi_print_dlgs: failed to print dialog </div>
<div>Mar 19 21:23:44 sip1 /usr/local/sbin/opensips[6115]: ERROR:mi_fifo:mi_fifo_server: command (dlg_list) processing failed </div></div><div><br></div><div>I've tried increasing the pkg mem in config.h:</div><div><div>
#define PKG_MEM_POOL_SIZE 4*1024*1024 /*!< Used only if PKG_MALLOC is defined*/</div><div>#define SHM_MEM_SIZE 32 /*!< Used if SH_MEM is defined*/</div><div><br></div><div>And followed it up with a make / make install / restart</div>
<div><br></div><div>And got the same result. I sent a SIGUSR1 to process 6115 and got the following:</div></div><div><br></div><div><br></div><div><div>[root@sip1 opensips-1.4.4-notls]# Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: Memory status (pkg): </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: fm_status (0x819ac00): </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: heap size= 4194304 </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: used= 72488, used+overhead=681312, free=3512992 </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: max used (+overhead)= 4194448 </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: dumping free list: </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 1 fragments no.: 3, unused: 0 bucket size: 8 - 8 (first 8) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 4 fragments no.: 20455, unused: 0 bucket size: 32 - 32 (first 32) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 5 fragments no.: 20315, unused: 0 bucket size: 40 - 40 (first 40) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 6 fragments no.: 9127, unused: 0 bucket size: 48 - 48 (first 48) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 7 fragments no.: 96, unused: 0 bucket size: 56 - 56 (first 56) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 8 fragments no.: 15195, unused: 0 bucket size: 64 - 64 (first 64) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 9 fragments no.: 3881, unused: 0 bucket size: 72 - 72 (first 72) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 10 fragments no.: 4311, unused: 0 bucket size: 80 - 80 (first 80) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 11 fragments no.: 10, unused: 0 bucket size: 88 - 88 (first 88) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 12 fragments no.: 16, unused: 0 bucket size: 96 - 96 (first 96) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 13 fragments no.: 25, unused: 0 bucket size: 104 - 104 (first 104) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 14 fragments no.: 4, unused: 0 bucket size: 112 - 112 (first 112) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 15 fragments no.: 1, unused: 0 bucket size: 120 - 120 (first 120) </div>
<div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: hash = 16 fragments no.: 1, unused: 0 bucket size: 128 - 128 (first 128) </div><div>Mar 19 21:21:25 sip1 /usr/local/sbin/opensips[6115]: TOTAL: 73440 free fragments = 3513160 free bytes </div>
<div><br></div><div><br></div><div>Not sure what to do here... any ideas?</div><div><br></div><div>Thanks,</div><div>Brett</div><div><br></div></div>
</blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>