[OpenSIPS-Users] Mysql Crashes and panics

Brett Nemeroff brett at nemeroff.com
Thu Apr 16 06:31:44 CEST 2009


All,
Ok, so I fixed my kernel panic issue.. But I'm not real happy with the fix.
I'm loading up like 157,000 routes.. each route has between 1-4 gateways in
the gwlist. however, **I only have 1 actual route in the dr_gateways
table**.. I hadn't added the other 3 gateways..

Now when dr_reload runs, it sucks up routes, but if there is a missing
gateway for that route, the entire route is dropped. I didn't expect that, I
thought it would have just skipped loading that gateway for that route.
Seems that all of that loading / unloading of routes halted my system. I
have no idea why.. But it's consistent and repeatable **on Ubuntu 8.04** I
did the same setup, same routes in CentOS 5.2 and could not for the life of
me reproduce the problem.

It's also worth mentioning that I hadn't increased the SHM in that config...


Ok, so different issue.. This is the same "opensips crashes under heavy db
load" issue.. I load up Opensips with 100 CPS with SIPP. It's real busy, and
processing real happily.

Then I run an external perl based rating script.. For about 15-20 second,
all is good.. then I start getting retrans, then opensips dies. I reported
this like a week ago, and I think bogdan pushed out some fixes that are in
1.5.1 (which I am running)... Well, my rating script was running, and I got
a DateTime error.. it was telling me that a Date/Time written in the DB
wasn't valid.. so I checked it out.. Look at this from my acc table:


+-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
| id    | method | from_tag   | to_tag                  | callid
        | sip_code | sip_reason                 | time                | ua
                 | from_did   | to_did | srcip            | gw         |
harvested | pdd  | trace |
+-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
| 69622 | 0      | 1510444289 | 22645-3410 at 1.2.3.4 | sip:sipp at 1.2.3.4:5061 |
341      | sip:9999 at 1.2.3.4:5060 | 0000-00-00 00:00:00 | udp:1.2.3.4:5060 |
1239854732 | 4      | udp:1.2.3.4 | 1239897933 |         0 |    1 |     1 |
+-------+--------+------------+-------------------------+----------------------------+----------+----------------------------+---------------------+-----------------------+------------+--------+------------------+------------+-----------+------+-------+
1 row in set (0.00 sec)

The data is all in the wrong fields!! This happened on exactly ONE record.

In addition, when I watch "SHOW PROCESSLIST" in mysql, i normally (even at
100CPS) just see like 4-6 "acc" inserts.. when my rating script runs, I see
my screen fill up (completely) with "acc" inserts. So I'm about to test this
with the max connections in mysql raised up to.. say... 1000. Maybe the
cause is running out of mysql connections for acc transactions under high
load..

-Brett
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.opensips.org/pipermail/users/attachments/20090415/ffa4bb42/attachment.htm 


More information about the Users mailing list