[OpenSIPS-Users] auto scaling
Bogdan-Andrei Iancu
bogdan at opensips.org
Mon Mar 18 11:22:12 EDT 2019
Hi Slava,
OK, I will need to run more tests on the TCP conns stuff - the intended
behavior is *NOT* to close the connections handled by the process to be
terminated.
Regards,
Bogdan-Andrei Iancu
OpenSIPS Founder and Developer
https://www.opensips-solutions.com
OpenSIPS Summit 2019
https://www.opensips.org/events/Summit-2019Amsterdam/
On 03/15/2019 12:47 PM, Slava Bendersky wrote:
> Hello Bogdan,
> Upscaling error is didn't show up any more in logs at least I didn't
> so it. Might need trigger bigger load.
>
> *do you do auto-scaling only for TCP ?*
>
> Our setup in most multi homed, as example public side TCP private
> side UDP
>
>
> *Now, about the TCP downscaling - I guess you see as terminated by
> OpenSIPS the TCP conns anchored in the process that is terminated ?*
>
> Yes, that how is look like end result that opensips start blocking TCP
> connections. If specific process handle sip registration via tcp and
> opensips trying close to down scale end point need send re register in
> order do not loose registration. Other wise it cause stale
> connections. Just close properly connection not enough I think.
>
>
> volga629
>
>
>
>
> ------------------------------------------------------------------------
> *From: *"Bogdan-Andrei Iancu" <bogdan at opensips.org>
> *To: *"OpenSIPS users mailling list" <users at lists.opensips.org>,
> "Slava Bendersky" <volga629 at networklab.ca>
> *Sent: *Thursday, March 14, 2019 1:45:20 PM
> *Subject: *Re: [OpenSIPS-Users] auto scaling
>
> Slava,
>
> What about the upscaling error you originally reported ? is there any
> way to reproduce it ? do you do auto-scaling only for TCP (no UDP,timer) ?
>
> Now, about the TCP downscaling - I guess you see as terminated by
> OpenSIPS the TCP conns anchored in the process that is terminated ? Is
> is a proper close of the connection ? or ?
>
> Regards,
> Bogdan-Andrei Iancu
>
> OpenSIPS Founder and Developer
> https://www.opensips-solutions.com
> OpenSIPS Summit 2019
> https://www.opensips.org/events/Summit-2019Amsterdam/
> On 03/14/2019 02:14 PM, Slava Bendersky wrote:
>
> Hello Bogdan,
> After we doing more testing with auto scaling we observed issue
> with TCP, where opensips try scale down the processes it tear down
> them and break TCP connections with end points and that cause
> blocked connection state where opensips stops process TCP connections.
>
> volga629
>
> ------------------------------------------------------------------------
> *From: *"Slava Bendersky" <volga629 at networklab.ca>
> *To: *"Bogdan-Andrei Iancu" <bogdan at opensips.org>
> *Cc: *"OpenSIPS users mailling list" <users at lists.opensips.org>
> *Sent: *Wednesday, March 13, 2019 12:21:14 AM
> *Subject: *Re: [OpenSIPS-Users] auto scaling
>
> I will do pull today.
>
> volga629
> ------------------------------------------------------------------------
> *From: *"Bogdan-Andrei Iancu" <bogdan at opensips.org>
> *To: *"Slava Bendersky" <volga629 at networklab.ca>
> *Cc: *"OpenSIPS users mailling list" <users at lists.opensips.org>
> *Sent: *Tuesday, March 12, 2019 4:52:06 AM
> *Subject: *Re: [OpenSIPS-Users] auto scaling
>
> Slava,
>
> Have you pulled my change on the improved log (just update from
> master) ? and post here the new output you get for the error.
>
> Thanks,
>
> Bogdan-Andrei Iancu
>
> OpenSIPS Founder and Developer
> https://www.opensips-solutions.com
> OpenSIPS Summit 2019
> https://www.opensips.org/events/Summit-2019Amsterdam/
>
> On 03/12/2019 05:51 AM, Slava Bendersky wrote:
>
> Hello Bogdan,
> My question how to calculate correctly
>
> *tcp_workers*
> *udp_workers*
> *
> *
> to properly assign with in auto scaling profile. Which
> parameters need use as base ?
>
> As example if vm 4GB memory up what will be max number for
> scale up processes and what should be value for tcp and udp
> workers.
> It message is appear in log on first attempt to fork in scale up.
>
> volga629
> ------------------------------------------------------------------------
> *From: *"Bogdan-Andrei Iancu" <bogdan at opensips.org>
> *To: *"OpenSIPS users mailling list"
> <users at lists.opensips.org>, "Slava Bendersky"
> <volga629 at networklab.ca>
> *Sent: *Monday, March 11, 2019 4:44:57 AM
> *Subject: *Re: [OpenSIPS-Users] auto scaling
>
> Hi Slava,
>
> Based on the OpenSIPS logs, did you get that error on the
> first forking attempt or sometime later after some number of
> new tcp processes forking ? More or less, my question is :
> what was the process creation/termination history before
> getting that bug log ?
>
> Also I just pushed a small commit to improve the date provided
> by the bug log.
>
> In regards to the "not clear how to calculate"...could you be
> specific ?
>
> Best regards,
>
> Bogdan-Andrei Iancu
>
> OpenSIPS Founder and Developer
> https://www.opensips-solutions.com
> OpenSIPS Summit 2019
> https://www.opensips.org/events/Summit-2019Amsterdam/
>
> On 03/10/2019 05:12 PM, Slava Bendersky wrote:
>
> Hello Everyone,
> Trying test auto scaling feature with following config
>
> auto_scaling_profile = PRF_SIP
> scale up to 24 on 70% for 4 cycles within 5
> scale down to 4 on 20% for 8 cycles
>
> On box 4096 Mb memory and 4 virtual CPU
>
> Getting in log
>
> CRITICAL:core:fork_dynamic_tcp_process: #012>>> trying to
> fork one more TCP worker but no free slots in the TCP
> table#012#012It seems you have hit a programming
> bug.#012Please help us make OpenSIPS better by reporting
> it at https://github.com/OpenSIPS/opensips/issues
>
>
> *Not clear how to calculate workers for tcp or udp*
>
> *tcp_workers=10* use_auto_scaling_profile PRF_SIP
> *listen=udp:lan_ip:5060* use_auto_scaling_profile PRF_SIP
>
>
> [root at vprx00 ~]# opensips -V
> version: opensips 3.0.0-dev (x86_64/linux)
> flags: STATS: On, SHM_EXTRA_STATS, DISABLE_NAGLE,
> USE_MCAST, SHM_MMAP, PKG_MALLOC, QM_MALLOC, DBG_MALLOC,
> FAST_LOCK-ADAPTIVE_WAIT
> ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144,
> MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
> poll method support: poll, epoll, sigio_rt, select.
> main.c compiled on 10:06:47 Mar 7 2019 with gcc 8
>
>
> volga629
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
>
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
>
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20190318/a00dd637/attachment-0001.html>
More information about the Users
mailing list