[OpenSIPS-Users] Mysql Crashes and panics
Bogdan-Andrei Iancu
bogdan at voice-system.ro
Thu Apr 16 10:27:36 CEST 2009
Hi Brett,
Brett Nemeroff wrote:
> All,
> Ok, so I fixed my kernel panic issue
Cool, what was the cause ?
> .. But I'm not real happy with the fix. I'm loading up like 157,000
> routes.. each route has between 1-4 gateways in the gwlist. however,
> **I only have 1 actual route in the dr_gateways table**.. I hadn't
> added the other 3 gateways..
>
> Now when dr_reload runs, it sucks up routes, but if there is a missing
> gateway for that route, the entire route is dropped. I didn't expect
> that, I thought it would have just skipped loading that gateway for
> that route.
Make sense - please open a bug report on the tracker about this.
> Seems that all of that loading / unloading of routes halted my system.
> I have no idea why.. But it's consistent and repeatable **on Ubuntu
> 8.04** I did the same setup, same routes in CentOS 5.2 and could not
> for the life of me reproduce the problem.
So, do you think it is OS or setup-only specific ?
>
> It's also worth mentioning that I hadn't increased the SHM in that
> config...
but do you get any error about mem (like running out of mem).
>
>
> Ok, so different issue.. This is the same "opensips crashes under
> heavy db load" issue.. I load up Opensips with 100 CPS with SIPP. It's
> real busy, and processing real happily.
OK
>
> Then I run an external perl based rating script.. For about 15-20
> second, all is good.. then I start getting retrans, then opensips
> dies. I reported this like a week ago, and I think bogdan pushed out
> some fixes that are in 1.5.1 (which I am running)... Well, my rating
> script was running, and I got a DateTime error.. it was telling me
> that a Date/Time written in the DB wasn't valid..
Could you post the exact error from the log ?
> so I checked it out.. Look at this from my acc table:
>
>
> +-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
> | id | method | from_tag | to_tag | callid
> | sip_code | sip_reason | time
> | ua | from_did | to_did | srcip
> | gw | harvested | pdd | trace |
> +-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
> | 69622 | 0 | 1510444289 | 22645-3410 at 1.2.3.4
> <mailto:22645-3410 at 1.2.3.4> | sip:sipp at 1.2.3.4:5061
> <http://sip:sipp@1.2.3.4:5061> | 341 | sip:9999 at 1.2.3.4:5060
> <http://sip:9999@1.2.3.4:5060> | 0000-00-00 00:00:00 |
> udp:1.2.3.4:5060 <http://1.2.3.4:5060> | 1239854732 | 4 |
> udp:1.2.3.4 | 1239897933 | 0 | 1 | 1 |
> +-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
> 1 row in set (0.00 sec)
>
> The data is all in the wrong fields!! This happened on exactly ONE record.
yeap....it looks messy...
>
> In addition, when I watch "SHOW PROCESSLIST" in mysql, i normally
> (even at 100CPS) just see like 4-6 "acc" inserts
do not fully follow you here - 100CPS should produce (INVITE+BYE)*100
acc records per sec -> 200 acc per sec.
> .. when my rating script runs, I see my screen fill up (completely)
> with "acc" inserts. So I'm about to test this with the max connections
> in mysql raised up to.. say... 1000. Maybe the cause is running out of
> mysql connections for acc transactions under high load..
opensips does not dynamically create more DB connection - whatever the
load is, the number of DB connection is the same - their number depends
only of the number of processes in opensips.
Regards,
Bogdan
>
> -Brett
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Users mailing list
> Users at lists.opensips.org
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>
More information about the Users
mailing list