[OpenSIPS-Users] Opensips 2.4.8 SEGFAULT

Sat Jul 11 08:44:58 EST 2020

I removed my force_send_socket() and I am now getting a different problem. 
 Stack trace of thread 20347:
 #0 0x00000000004c4363 fm_malloc (opensips)
 #1 0x00007fcffdb945e8 alter_mediaip.isra.22.constprop.39 (rtpproxy.so)
 #2 0x00007fcffdba52e4 force_rtp_proxy_body (rtpproxy.so)
 #3 0x00007fcffdba6768 force_rtp_proxy (rtpproxy.so)
 #4 0x00007fcffdba7e0b rtpproxy_offer5_f (rtpproxy.so)
 #5 0x00000000004284bc do_action (opensips)
 #6 0x000000000042f310 run_action_list (opensips)
 #7 0x000000000042d3f8 do_action (opensips)
 #8 0x000000000042f310 run_action_list (opensips)
 #9 0x000000000042d3f8 do_action (opensips)
 #10 0x000000000042f310 run_action_list (opensips)
 #11 0x000000000042f39c run_actions (opensips)
 #12 0x000000000042c0dc do_action (opensips)
 #13 0x000000000042f310 run_action_list (opensips)
 #14 0x000000000042d3f8 do_action (opensips)
 #15 0x000000000042f310 run_action_list (opensips)
 #16 0x000000000042f5db run_top_route (opensips)
 #17 0x00000000004351b9 receive_msg (opensips)
 #18 0x000000000055c5e6 udp_read_req (opensips)
 #19 0x00000000005413bf udp_start_processes (opensips)
 #20 0x0000000000417fb5 main (opensips)
 #21 0x00007fd63fdac873 __libc_start_main (libc.so.6)
 #22 0x000000000041882e _start (opensips)
(gdb) bt full
#0 0x00000000004c4363 in fm_malloc ()
No symbol table info available.
#1 0x00007fcffdb945e8 in alter_mediaip.isra.22.constprop () from /usr/lib64/opensips/modules/rtpproxy.so
No symbol table info available.
#2 0x00007fcffdba52e4 in force_rtp_proxy_body () from /usr/lib64/opensips/modules/rtpproxy.so
No symbol table info available.
#3 0x00007fcffdba6768 in force_rtp_proxy () from /usr/lib64/opensips/modules/rtpproxy.so
No symbol table info available.
#4 0x00007fcffdba7e0b in rtpproxy_offer5_f () from /usr/lib64/opensips/modules/rtpproxy.so
No symbol table info available.
#5 0x00000000004284bc in do_action ()
No symbol table info available.
#6 0x000000000042f310 in run_action_list ()
No symbol table info available.
#7 0x000000000042d3f8 in do_action ()
No symbol table info available.
#8 0x000000000042f310 in run_action_list ()
No symbol table info available.
#9 0x000000000042d3f8 in do_action ()
No symbol table info available.
#10 0x000000000042f310 in run_action_list ()
No symbol table info available.
#11 0x000000000042f39c in run_actions ()
No symbol table info available.
#12 0x000000000042c0dc in do_action ()
No symbol table info available.
#13 0x000000000042f310 in run_action_list ()
No symbol table info available.
#14 0x000000000042d3f8 in do_action ()
No symbol table info available.
#15 0x000000000042f310 in run_action_list ()
No symbol table info available.
#16 0x000000000042f5db in run_top_route ()
No symbol table info available.
#17 0x00000000004351b9 in receive_msg ()
No symbol table info available.
#18 0x000000000055c5e6 in udp_read_req ()
No symbol table info available.
#19 0x00000000005413bf in udp_start_processes ()
No symbol table info available.
#20 0x0000000000417fb5 in main ()
No symbol table info available.
July 10, 2020 6:10 PM, "James" <opensips at jfive.net (mailto:opensips at jfive.net?to=%22James%22%20<opensips at jfive.net>)> wrote:
I made a little more progress. This is what I have now.

Message: Process 18626 (opensips) of user 993 dumped core.

Stack trace of thread 18626:
#0 0x00007fe49e05b9e0 t_should_relay_response (tm.so)
#1 0x00007fe49e05daa3 relay_reply (tm.so)
#2 0x00007fe49e060905 reply_received (tm.so)
#3 0x000000000044a4f8 forward_reply (opensips)
#4 0x0000000000434248 receive_msg (opensips)
#5 0x000000000055c5e6 udp_read_req (opensips)
#6 0x00000000005413bf udp_start_processes (opensips)
#7 0x0000000000417fb5 main (opensips)
#8 0x00007feade6fa873 __libc_start_main (libc.so.6)
#9 0x000000000041882e _start (opensips)

(gdb) bt full
#0 0x00007fe49e05b9e0 in t_should_relay_response () from /usr/lib64/opensips/modules/tm.so
No symbol table info available.
#1 0x00007fe49e05daa3 in relay_reply () from /usr/lib64/opensips/modules/tm.so
No symbol table info available.
#2 0x00007fe49e060905 in reply_received () from /usr/lib64/opensips/modules/tm.so
No symbol table info available.
#3 0x000000000044a4f8 in forward_reply ()
No symbol table info available.
#4 0x0000000000434248 in receive_msg ()
No symbol table info available.
#5 0x000000000055c5e6 in udp_read_req ()
No symbol table info available.
#6 0x00000000005413bf in udp_start_processes ()
No symbol table info available.
#7 0x0000000000417fb5 in main ()
No symbol table info available.

I am using force_send_socket(udp:1.2.3.4:5060) with mhomed=1. Would this be an issue?

July 10, 2020 1:02 PM, "James via Users" <users at lists.opensips.org (mailto:users at lists.opensips.org?to=%22James%20via%20Users%22%20<users at lists.opensips.org>)> wrote:
Hello! I am having an issue with opensips crashing. I have reviewed the guide on how to generate a core dump. My current problem is when I try to use gdb.

Here is what I am doing:

gdb /usr/sbin/opensips core.opensips.993.b6ac8a71177a49cd8238e22ba265c6e9.16129.1594410164000000.lz4

GNU gdb (GDB) Red Hat Enterprise Linux 8.2-11.el8
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html (http://gnu.org/licenses/gpl.html)>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs (http://www.gnu.org/software/gdb/bugs/)>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation (http://www.gnu.org/software/gdb/documentation/)>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/opensips...Reading symbols from .gnu_debugdata for /usr/sbin/opensips...(no debugging symbols found)...done.
(no debugging symbols found)...done.
"/var/lib/systemd/coredump/core.opensips.993.b6ac8a71177a49cd8238e22ba265c6e9.16129.1594410164000000.lz4" is not a core dump: file format not recognized
Missing separate debuginfos, use: yum debuginfo-install opensips-2.4.8-1.el8.x86_64

I am running Centos 8. I installed opensips using the RPM from the opensips download site. The dump file is generated from systemd. I added the -w flag the service to put the dump file in the opensips directory but that did not change the location of the dump file.

Here is the information from the crash in the logs.

/usr/sbin/opensips[16129]: CRITICAL:core:sig_usr: segfault in process pid: 16129, id: 7
kernel: opensips[16129]: segfault at 0 ip 00000000004c4363 sp 00007ffcdf449470 error 6 in opensips[400000+212000]
kernel: Code: c4 28 5b 5d 41 5c 41 5d 41 5e 41 5f c3 66 2e 0f 1f 84 00 00 00 00 00 48 c1 e8 03 89 c2 e9 8c fb ff ff 0f 1f 44 00 00 48 89 c2 <48> 89 37 48 c1 ea 03 48 c1 e2 04 48 01 ea 48 8b 4a 58 48 83 e9 01
systemd[1]: Started Process Core Dump (PID 16147/UID 0).
Opensips info

version: opensips 2.4.8 (x86_64/linux)
flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll, sigio_rt, select.
main.c compiled on 19:27:39 Jun 30 2020 with gcc 8

My opensips start command
/usr/sbin/opensips -P /run/opensips/opensips.pid -f /etc/opensips/opensips.cfg -m 20480 -M 5120 -w /etc/opensips/dump
What am I missing in order to get a gdb core dump?

Thanks,

James
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensips.org/pipermail/users/attachments/20200711/4f65fc96/attachment.html>