<div dir="ltr">No this server is running only OpenSIPS and mysql, here is a report of iotop which I took when the resources was going down<br><br><div>Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 78.77 K/s</div><div> TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND</div><div> 153 be/3 root 0.00 B/s 0.00 B/s 0.00 % 0.08 % [jbd2/vda1-8]</div><div> 1681 be/4 mysql 0.00 B/s 7.88 K/s 0.00 % 0.06 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 1711 be/4 mysql 0.00 B/s 3.94 K/s 0.00 % 0.05 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 647 be/4 root 0.00 B/s 3.94 K/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]</div><div> 2048 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.00 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 1 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % init</div><div> 2 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kthreadd]</div><div> 3 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/0]</div><div> 2052 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.00 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 5 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/0:0H]</div><div> 6 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/u16:0]</div><div> 7 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [rcu_sched]</div><div> 8 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [rcu_bh]</div><div> 9 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/0]</div><div> 10 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/0]</div><div> 11 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/1]</div><div> 12 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/1]</div><div> 13 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/1]</div><div> 1038 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.00 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 15 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/1:0H]</div><div> 16 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/2]</div><div> 17 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/2]</div><div> 18 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/2]</div><div> 2051 be/4 opensips 0.00 B/s 0.00 B/s 0.00 % 0.00 % opensips -P /var/run/opensips/opensips.pid -m 128 -M 4 -u opensips -g opensips -f /etc/opensips/opensips.cfg</div><div> 20 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/2:0H]</div><div> 21 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/3]</div><div> 22 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/3]</div><div> 23 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/3]</div><div> 2072 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.00 % mysqld --basedir=/usr --datadir=/var/lib/mysql --plug~d.pid --socket=/var/run/mysqld/mysqld.sock --port=3306</div><div> 25 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/3:0H]</div><div> 26 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/4]</div><div> 27 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/4]</div><div> 28 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/4]</div><div> 2077 be/4 opensips 0.00 B/s 0.00 B/s 0.00 % 0.00 % opensips -P /var/run/opensips/opensips.pid -m 128 -M 4 -u opensips -g opensips -f /etc/opensips/opensips.cfg</div><div> 30 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/4:0H]</div><div> 31 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/5]</div><div> 32 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/5]</div><div> 33 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/5]</div><div> 34 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/5:0]</div><div> 35 be/0 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/5:0H]</div><div> 36 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/6]</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Dec 21, 2016 at 7:25 PM, Liviu Chircu <span dir="ltr"><<a href="mailto:liviu@opensips.org" target="_blank">liviu@opensips.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p><tt>Okay, so it seems lots of CPU cycles are spent in the kernel!</tt></p>
<p><tt>Are you sure there isn't any intensive I/O going on? For
example, maybe you are pushing lots of gateway pings. You could
run "iostat 1" to assess this.</tt></p><span class="">
<p><tt>Regards,</tt><br>
</p>
<pre class="m_-2303889885518532524moz-signature" cols="72">Liviu Chircu
OpenSIPS Developer
<a class="m_-2303889885518532524moz-txt-link-freetext" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.<wbr>com</a></pre>
</span><div><div class="h5"><div class="m_-2303889885518532524moz-cite-prefix">On 21.12.2016 18:58, Schneur Rosenberg
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>procs -----------memory---------- ---swap-- -----io----
-system-- ------cpu-----</div>
<div> r b swpd free buff cache si so bi bo
in cs us sy id wa st</div>
<div> 7 0 0 9966412 296728 5239152 0 0 3 60
0 0 0 0 99 0 0</div>
<div> 6 0 0 9966684 296728 5239152 0 0 0 20
2075 1569 12 64 24 0 0</div>
<div> 7 0 0 9966588 296728 5239152 0 0 0 20
2023 1408 12 64 24 0 0</div>
<div> 4 0 0 9966492 296728 5239152 0 0 0 108
2027 1434 11 63 26 0 0</div>
<div> 5 0 0 9966588 296728 5239152 0 0 0 44
1687 1232 11 52 38 0 0</div>
<div> 5 0 0 9966620 296728 5239156 0 0 0 72
1704 1136 9 53 37 0 0</div>
<div> 6 0 0 9966492 296728 5239156 0 0 0 40
1874 1133 11 64 25 0 0</div>
<div> 6 0 0 9966524 296728 5239156 0 0 0 20
1794 853 11 65 25 0 0</div>
<div> 6 0 0 9966556 296728 5239156 0 0 0 56
1810 951 11 64 25 0 0</div>
<div> 6 0 0 9966620 296728 5239156 0 0 0 0
1802 934 10 65 25 0 0</div>
<div> 7 0 0 9966556 296728 5239160 0 0 0 2328
2356 1489 12 76 12 0 0</div>
<div> 7 0 0 9966460 296728 5239160 0 0 0 0
2074 929 12 76 12 0 0</div>
<div> 7 0 0 9966588 296728 5239164 0 0 0 0
2022 728 11 76 12 0 0</div>
<div> 7 0 0 9966620 296728 5239164 0 0 0 0
2015 802 14 74 12 0 0</div>
<div> 5 0 0 9966652 296728 5239164 0 0 0 72
2275 1049 14 81 5 0 0</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Dec 21, 2016 at 6:42 PM, Liviu
Chircu <span dir="ltr"><<a href="mailto:liviu@opensips.org" target="_blank">liviu@opensips.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p><tt>Hi Schneur,</tt></p>
<p><tt>Those warnings are due to a rather harmless bug,
which was fixed and backported ~ two weeks ago.</tt></p>
<p><tt>Regarding 100% CPU usage though, could you please
run "vmstat 1" for 10 seconds and paste the full
output? Thanks!<br>
</tt></p>
<p><tt>Regards,<br>
</tt></p>
<pre class="m_-2303889885518532524m_-11065940957955827moz-signature" cols="72">Liviu Chircu
OpenSIPS Developer
<a class="m_-2303889885518532524m_-11065940957955827moz-txt-link-freetext" href="http://www.opensips-solutions.com" target="_blank">http://www.opensips-solutions.<wbr>com</a></pre><div><div class="m_-2303889885518532524h5">
<div class="m_-2303889885518532524m_-11065940957955827moz-cite-prefix">On 21.12.2016 18:17, Schneur Rosenberg
wrote:
</div>
</div></div><blockquote type="cite"><div><div class="m_-2303889885518532524h5">
<div dir="ltr">Hi, I'm running a instance of OpenSIPS (just
signalling no RTP on this machine) on a DigitalOcean VM, it was
running fine for a while and it does not process lots of CPS
(4-5 max) and today I was getting complaints of dropped calls, I
checked the logs and I saw lots of
WARNING:core:utimer_ticker: utimer task <tm-utimer>
already scheduled for 3956760 ms (now 3956860 ms), it may
overlap
<div>and
WARNING:core:handle_timer_job<wbr>: utimer job <tm-utimer>
has a 30000 us delay in execution
</div>
<div>I had 4 children and I upped it to 15, I think it helped
but not completely solved the problem.
When running top I see all of the sudden a few opensips
processes jumping to 100% and the idle resources slowly going
down sometimes even to 0% then it recovers, I haven't changed
anything in my cfg file lately and the traffic has not
increased etc.
Is there anyway to see in the logs whats taking so much
resources? I'm also wondering if its can be a DigitalOcean
issue where other users on the same Hyperviser are using very
high resources and its stealing my resources.</div>
<div>
</div>
<div>thank you</div>
</div>
<fieldset class="m_-2303889885518532524m_-11065940957955827mimeAttachmentHeader"></fieldset>
</div></div><pre>______________________________<wbr>_________________
Users mailing list
<a class="m_-2303889885518532524m_-11065940957955827moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_-2303889885518532524m_-11065940957955827moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
</blockquote>
</div>
______________________________<wbr>_________________
Users mailing list
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</blockquote></div>
</div>
<fieldset class="m_-2303889885518532524mimeAttachmentHeader"></fieldset>
<pre>______________________________<wbr>_________________
Users mailing list
<a class="m_-2303889885518532524moz-txt-link-abbreviated" href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a>
<a class="m_-2303889885518532524moz-txt-link-freetext" href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a>
</pre>
</blockquote>
</div></div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.opensips.org/cgi-<wbr>bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>