<html><body>
<p><font size="2">Hi Brett,</font><br>
<br>
<font size="2">While this doesn't address the root problem, we do two thing: (a) run with ~100MB of pkg mem (per process), and (b) run a monitor script checking syslog for out of memory messages, and restart all the processes. Not elegant, but better than zombies.</font><br>
<br>
<font size="2">I noticed in your log that you're also out of shmem. Do you know which comes first? (running out of pkg or shmem)?</font><br>
<br>
<font size="2">Regards,</font><br>
<font size="2">Kennard</font><br>
<br>
<img width="16" height="16" src="cid:1__=07BBFDC6DF9D58F88f9e8a93df9@logitech.com" border="0" alt="Inactive hide details for Brett Nemeroff ---07/01/2010 05:47:57 AM---Hello list, Using dispatcher on 1.6.1-notls on a system wi"><font size="2" color="#424282">Brett Nemeroff ---07/01/2010 05:47:57 AM---Hello list, Using dispatcher on 1.6.1-notls on a system with fairly high load. Config is</font><br>
<br>
<font size="2" color="#5F5F5F">From: </font><font size="2">Brett Nemeroff <brett@nemeroff.com></font><br>
<font size="2" color="#5F5F5F">To: </font><font size="2">users@lists.opensips.org</font><br>
<font size="2" color="#5F5F5F">Date: </font><font size="2">07/01/2010 05:47 AM</font><br>
<font size="2" color="#5F5F5F">Subject: </font><font size="2">[OpenSIPS-Users] no pkg mem</font><br>
<font size="2" color="#5F5F5F">Sent by: </font><font size="2">users-bounces@lists.opensips.org</font><br>
<hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br>
<br>
<br>
Hello list,<br>
Using dispatcher on 1.6.1-notls on a system with fairly high load. Config is pretty vanilla, includes rtpproxy and acc.<br>
<br>
After running for about 2 days, calls fail with no audio because no pkg mem to parse stuff. I've recompiled with a 4 x multipler:<br>
#define PKG_MEM_POOL_SIZE 4*1024*1024 /*!< Used only if PKG_MALLOC is defined*/<br>
<br>
Any ideas on how to fix? a big problem I have here is that the box still replies to Option requests :/ so nothing fails over, just fails with no audio.<br>
<br>
Syslog shows the following:<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: incoming reply<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:core:parse_headers: pkg memory allocation failed<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:textops:has_body_f: Failed to get bodies<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:core:del_lump: out of pkg memory<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:core:build_res_buf_from_sip_res: failed to remove first via<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:tm:relay_reply: no mem for outbound reply buffer<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13559]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 464<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:parse_from_header: out of pkg_memory<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:siptrace:trace_onreply_in: cannot parse FROM header<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: incoming reply<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:parse_headers: pkg memory allocation failed<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:textops:has_body_f: Failed to get bodies<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:del_lump: out of pkg memory<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:build_res_buf_from_sip_res: failed to remove first via<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:tm:relay_reply: no mem for outbound reply buffer<br>
Jul 1 08:40:40 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 464<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:core:via_builder: out of pkg memory<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:core:build_req_buf_from_sip_req: no via received!<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:tm:print_uac_request: no more shm_mem<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:tm:t_forward_nonack: failure to add branches<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 424<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 424<br>
Jul 1 08:40:41 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13563]: ERROR:sl:sl_send_reply_helper: response building failed<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:via_builder: out of pkg memory<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:build_req_buf_from_sip_req: no via received!<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:tm:print_uac_request: no more shm_mem<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:tm:t_forward_nonack: failure to add branches<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 425<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 425<br>
Jul 1 08:40:42 opensips1 /usr/local/sbin/opensips 83 [local0.err] /usr/local/sbin/opensips[13562]: ERROR:sl:sl_send_reply_helper: response building failed<br>
<br>
<br>
Thanks,<br>
Brett<br>
<tt><font size="2">_______________________________________________<br>
Users mailing list<br>
Users@lists.opensips.org<br>
</font></tt><tt><font size="2"><a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a></font></tt><tt><font size="2"><br>
</font></tt><br>
</body></html>