I had this core file overwriting problem about a year ago and i fixed it by setting linux kernel core pattern. It really helps me in identifying the correct core file to debug. You can do it too by setting something like below in sysctl.conf,<div>
<br></div><div>kernel.core_pattern=/tmp/core.%e.%p.%h.%t</div><div><br></div><div>OR run below command,</div><div><br></div><div>echo "/tmp/cores/core.%e.%p.%h.%t" > /proc/sys/kernel/core_pattern<br><div><br>
</div><div>Interesting switches that can be used are,</div><div><br></div><div><div>%p: pid</div><div>%u: uid</div><div>%g: gid</div><div>%s: signal number</div><div>%t: UNIX time of dump</div><div>%h: hostname</div><div>
%e: executable filename</div></div><div><br></div><div>Thank you.</div><div><br><br><div class="gmail_quote">On Thu, Feb 14, 2013 at 12:18 PM, Brett Nemeroff <span dir="ltr"><<a href="mailto:brett@nemeroff.com" target="_blank">brett@nemeroff.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">1.8.2-notls (x86_64/linux)<div>svnrevision: 2:9777M<div><div class="h5"><br><br><div class="gmail_quote">On Thu, Feb 14, 2013 at 2:01 AM, Muhammad Shahzad <span dir="ltr"><<a href="mailto:shaheryarkh@gmail.com" target="_blank">shaheryarkh@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Please specify opensips version / revision.<div><br></div><div>Thank you.<br><div><br><br><div class="gmail_quote"><div>
<div>On Thu, Feb 14, 2013 at 8:13 AM, Brett Nemeroff <span dir="ltr"><<a href="mailto:brett@nemeroff.com" target="_blank">brett@nemeroff.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>Hey all,<div>I'm running into a crash. Same thing hits over and over. Not sure what's causing it.. Here's a bt:</div>
<div><br></div><div><div><div>Program terminated with signal 11, Segmentation fault.</div><div>
#0 0x00007f33ce3339b9 in db_mysql_val2bind (v=0x7f330fa18cc0, binds=0x7f33ce88cf00, i=33) at val.c:297</div><div>297<span style="white-space:pre-wrap"> </span>*(binds[i].is_null) = 0;</div><div>Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.80.el6_3.7.x86_64 hiredis-0.10.1-3.el6.x86_64 json-c-0.10-2.el6.x86_64 keyutils-libs-1.4-4.el6.x86_64 krb5-libs-1.9-33.el6_3.3.x86_64 libcom_err-1.41.12-12.el6.x86_64 libmemcached-0.31-1.1.el6.x86_64 libselinux-2.0.94-5.3.el6.x86_64 mysql-libs-5.1.67-1.el6_3.x86_64 nss-softokn-freebl-3.12.9-11.el6.x86_64 openssl-1.0.0-25.el6_3.1.x86_64 zlib-1.2.3-27.el6.x86_64</div>
<div>(gdb) bt full</div><div>#0 0x00007f33ce3339b9 in db_mysql_val2bind (v=0x7f330fa18cc0, binds=0x7f33ce88cf00, i=33) at val.c:297</div><div> t = <value optimized out></div><div> mt = <value optimized out></div>
<div> __FUNCTION__ = "db_mysql_val2bind"</div><div>#1 0x00007f33ce32d34c in db_mysql_do_prepared_query (conn=0x7f33ce88cd68, v=<value optimized out>, n=36, uv=<value optimized out>, un=0, query=0x7f33ce5477b0) at dbase.c:584</div>
<div> i = 33</div><div> j = <value optimized out></div><div> code = <value optimized out></div><div> cols = <value optimized out></div><div> pq_ptr = 0x7f33ce88cec0</div>
<div> ctx = 0x7f33ce88e310</div><div> mysql_bind = 0x7f33ce88cf00</div><div> start = {tv_sec = 139860479483003, tv_usec = 5334081}</div><div> buffered_rows = 0x0</div><div>#2 0x00007f33ce32fcae in db_mysql_insert (_h=0x7f33ce88cd68, _k=0x7f330d73197b, _v=0x7f330fa188a0, _n=36) at dbase.c:1028</div>
<div> ret = <value optimized out></div><div>#3 0x0000000000517729 in flush_query_list () at db/db_insertq.c:133</div><div> it = 0x7f330d7318a0</div><div> my_ps = 0x7f33ce88cec0</div><div> i = <value optimized out></div>
<div> __FUNCTION__ = "flush_query_list"</div><div>#4 0x000000000051799c in handle_ql_shutdown () at db/db_insertq.c:170</div><div>No locals.</div><div>#5 0x000000000042c2c1 in cleanup (show_status=1) at main.c:347</div>
<div> __FUNCTION__ = "cleanup"</div></div></div><div><br></div><div><br></div><div>and in case you need it:</div><div><div>(gdb) print *binds</div><div>$1 = {length = 0x7f33ce88dd70, is_null = 0x7f33ce88dd78 "", buffer = 0x7f330fa18d20, error = 0x0, row_ptr = 0x0, store_param_func = 0, fetch_result = 0, skip_result = 0, buffer_length = 0, offset = 0, </div>
<div> length_value = 0, param_number = 0, pack_length = 0, buffer_type = MYSQL_TYPE_STRING, error_value = 0 '\000', is_unsigned = 0 '\000', long_data_used = 0 '\000', is_null_value = 0 '\000', </div>
<div> extension = 0x0}</div></div><div><br></div><div><div>(gdb) print binds[33]</div><div>$2 = {length = 0x6, is_null = 0x0, buffer = 0x18, error = 0x0, row_ptr = 0x16 <Address 0x16 out of bounds>, store_param_func = 0, fetch_result = 0x25, skip_result = 0, buffer_length = 3, offset = 0, </div>
<div> length_value = 2, param_number = 0, pack_length = 0, buffer_type = 40, error_value = 0 '\000', is_unsigned = 0 '\000', long_data_used = 0 '\000', is_null_value = 0 '\000', extension = 0x0}</div>
<div>(gdb) </div></div><div><br></div><div><br></div><div>Please let me know if you need any further testing. Thanks!!!</div><span><font color="#888888"><div>-Brett</div><div><br></div>
</font></span><br></div></div>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br></blockquote></div><span><font color="#888888"><br><br clear="all"><div><br></div>-- <br><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">Muhammad Shahzad</span><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">------------------------------</span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">-----</span><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">CISCO Rich Media Communication Specialist (CRMCS)</span><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">CISCO Certified Network Associate (CCNA)</span><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">Cell: <a href="tel:%2B49%20176%2099%2083%2010%2085" value="+4917699831085" target="_blank">+49 176 99 83 10 85</a></span><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">MSN: </span><a href="mailto:shari_786pk@hotmail.com" style="color:rgb(17,85,204);font-size:13px;font-family:arial,sans-serif" target="_blank">shari_786pk@hotmail.com</a><br style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">
<span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">Email: </span><a href="mailto:shaheryarkh@googlemail.com" style="color:rgb(17,85,204);font-size:13px;font-family:arial,sans-serif" target="_blank">shaheryarkh@googlemail.com</a>
</font></span></div></div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org" target="_blank">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div></div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opensips.org">Users@lists.opensips.org</a><br>
<a href="http://lists.opensips.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.opensips.org/cgi-bin/mailman/listinfo/users</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Muhammad Shahzad</span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">------------------------------</span><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">-----</span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">CISCO Rich Media Communication Specialist (CRMCS)</span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">CISCO Certified Network Associate (CCNA)</span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Cell: +49 176 99 83 10 85</span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">MSN: </span><a href="mailto:shari_786pk@hotmail.com" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank">shari_786pk@hotmail.com</a><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">
<span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)">Email: </span><a href="mailto:shaheryarkh@googlemail.com" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:13px;background-color:rgb(255,255,255)" target="_blank">shaheryarkh@googlemail.com</a>
</div></div>