<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span>Found some extra error logs that might be related to this. checking how we can fix this</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span><br>
</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span>/usr/sbin/opensips[1983]: ERROR:proto_bin:add_write_chunk: We have reached the limit of max async postponed chunks<br>
</span>
<div>/usr/sbin/opensips[1983]: ERROR:proto_bin:proto_bin_send: failed to send<br>
</div>
<div>/usr/sbin/opensips[1983]: ERROR:clusterer:msg_send: send() to 10.2.2.16:5566 for proto bin/7 failed<br>
</div>
<span></span><br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
--</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Regards,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
William Jin<br>
</div>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> William Jin <williamj@exetel.com.au><br>
<b>Sent:</b> Thursday, 2 July 2020 11:24 AM<br>
<b>To:</b> OpenSIPS users mailling list <users@lists.opensips.org><br>
<b>Subject:</b> Re: [OpenSIPS-Users] Usrloc can't be sync after upgrade to 2.4.8</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thanks for the info.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I have upgraded both nodes to latest 2.4.8, and restarted opensips on both nodes so it should start from empty.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">The error "<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">INFO:usrloc:receive_binary_packets:
discarding , ver 1: need ver 2" <span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">is gone.</span></span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<div style="margin:0px; font-size:12pt; font-family:Calibri,Arial,Helvetica,sans-serif">
However, the 2nd node usrloc is still not synced with 1st node(seed), e<span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">ven manually issue the command opensipsctl fifo ul_cluster_sync. </span></div>
</div>
<div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
my config: (on both node)</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span># ----- usrloc params -----<br>
</span>
<div>modparam("usrloc", "cluster_mode", "full-sharing")<br>
</div>
<div>modparam("usrloc", "nat_bflag", "NAT")<br>
</div>
<div>modparam("usrloc", "location_cluster", 1)<br>
</div>
<span>modparam("usrloc", "restart_persistency", "sync-from-cluster")</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
The clusterer table:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span> id | cluster_id | node_id | url | state | no_ping_retries | priority | sip_addr | description | flags<br>
</span>
<div>----+------------+---------+--------------------+-------+-----------------+----------+----------+-------------+-------<br>
</div>
<div> 2 | 1 | 2 | bin:10.2.2.16:5566 | 1 | 3 | 50 | | node2 | <br>
</div>
<div> 1 | 1 | 1 | bin:10.2.2.15:5566 | 1 | 3 | 50 | | node1 | seed<br>
</div>
<span></span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
>From node1 log:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: INFO:clusterer:handle_internal_msg: Node [2] is UP<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: INFO:clusterer:handle_sync_request: Received sync request for capability 'dialog-dlg-repl' from node 2, cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: INFO:clusterer:send_sync_repl: Sent all sync packets for capability 'dialog-dlg-repl' to node 2, cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: INFO:clusterer:handle_sync_request: Received sync request for capability 'usrloc-contact-repl' from node 2, cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:msg_send: send() to 10.2.2.16:5566 for proto bin/7 failed<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:msg_send_retry: msg_send() to node [2] failed<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:cl_sync_chunk_start: Failed to send sync packet<br>
</div>
<div>...<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:cl_sync_chunk_start: Failed to send sync packet<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:send_sync_repl: Failed to send sync packet, rc=-1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[1983]: ERROR:clusterer:send_sync_repl: Failed to send sync end message<br>
</div>
<span>Jul 2 10:55:56 /usr/sbin/opensips[1983]: INFO:clusterer:handle_internal_msg: Node [2] is UP</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Node2 log:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span>Jul 2 10:55:56 /usr/sbin/opensips[13782]: INFO:clusterer:handle_internal_msg: Node [1] is UP<br>
</span>
<div>Jul 2 10:55:56 /usr/sbin/opensips[13782]: INFO:clusterer:send_sync_req: Sent sync request for capability 'dialog-dlg-repl' to node 1, cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[13782]: INFO:clusterer:send_sync_req: Sent sync request for capability 'usrloc-contact-repl' to node 1, cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[13782]: INFO:clusterer:handle_sync_packet: Received all sync packets for capability 'dialog-dlg-repl' in cluster 1<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[13793]: INFO:core:probe_max_sock_buff: using snd buffer of 512 kb<br>
</div>
<div>Jul 2 10:55:56 /usr/sbin/opensips[13793]: INFO:core:init_sock_keepalive: TCP keepalive enabled on socket 184<br>
</div>
<span></span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
we have around 30,000 end devices(UDP), and I found the <a href="https://github.com/OpenSIPS/opensips/issues/1976">https://github.com/OpenSIPS/opensips/issues/1976</a>, not sure if it's related</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Any idea? Do I need to increase the ping_timeout and give it a try?</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="color:rgb(0,0,0); font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt">--</span><br>
</div>
<div id="x_Signature">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Regards,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
William Jin<br>
</div>
</div>
</div>
<div id="x_appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Users <users-bounces@lists.opensips.org> on behalf of Liviu Chircu <liviu@opensips.org><br>
<b>Sent:</b> Wednesday, 1 July 2020 4:48 PM<br>
<b>To:</b> OpenSIPS users mailling list <users@lists.opensips.org><br>
<b>Subject:</b> Re: [OpenSIPS-Users] Usrloc can't be sync after upgrade to 2.4.8</font>
<div> </div>
</div>
<div class="x_BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="x_PlainText">On 01.07.2020 09:39, Liviu Chircu wrote:<br>
> then re-register them manually with the "ul_add" [2] command that and <br>
> some Python scripting logic, for example.<br>
<br>
Sorry, I meant bash, not Python. Not that I have anything against <br>
Python, but the former script (basically a simple loop) is much quicker <br>
to write in order to achieve your purpose.<br>
<br>
-- <br>
Liviu Chircu<br>
<a href="http://www.twitter.com/liviuchircu">www.twitter.com/liviuchircu</a> | <a href="http://www.opensips-solutions.com">
www.opensips-solutions.com</a><br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
Users@lists.opensips.org<br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
</div>
</span></font></div>
</div>
</body>
</html>