<div dir="ltr">What are the recommended solutions for posting data to an external system with the lowest latency? Today we're using a Redis list to push data from OpenSIPS and pull it from Redis using Logstash. These are call detail records that need to reach our OpenSearch index with minimum delay.<div><br></div><div>We have Redis running in memory-only mode to reduce latency, largely because the underlying storage is a very busy SAN. The current pipeline works until there is a disruption to Logstash or OpenSearch. If the disruption is not corrected quickly enough, Redis runs out of memory and we lose data. If Redis crashes, OpenSIPS itself breaks down.</div><div><br></div><div>Is there a more robust solution for getting things to OpenSearch? Latency is the goal, but we need to tolerate disruption without data loss.<br clear="all"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><span><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;font-weight:800;vertical-align:baseline;white-space:pre-wrap"><br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;font-weight:800;vertical-align:baseline;white-space:pre-wrap"><br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;font-weight:800;vertical-align:baseline;white-space:pre-wrap">Calvin Ellison</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Systems Architect</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><a href="mailto:calvin.ellison@voxox.com" target="_blank">calvin.ellison@voxox.com</a></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">+1 (213) 285-0555</span><span style="font-size:2.25pt;font-family:"Proxima Nova",sans-serif;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><br><br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><a href="http://voxox.com" target="_blank"><span style="font-size:10pt;font-family:"Proxima Nova",sans-serif;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:139px;height:53px"><img src="https://lh5.googleusercontent.com/IpUfF3j5Y4T9UmEfLISsHXhgSenc131vheivxwdo6oyzyT1i5KfVnK8cftA1Qx-APliNpMTLx5PUOZ6k1lXHgMZvDXTXKkOWDpmXMlUcmsoKBZQIE_wip4sS8XMtdryakordMboW" width="139" height="53" style="margin-left:0px;margin-top:0px"></span></span></a></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><a href="https://www.facebook.com/VOXOX/" target="_blank"><span style="font-size:12pt;font-family:"Proxima Nova",sans-serif;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:27px;height:27px"><img src="https://lh6.googleusercontent.com/qS_cwPUkKDN7UEAMffT5cjE1qN41OWxwS8HKu2DZi8R9OfYZCrdVxxPsyJy_SOaTDjWHjPAsBAzGnrgiSgrqDFWQKoi1HAdYUldZOtUQY_2EH0FC7M67fPko4xEmw7yfwiIpnRIF" width="27" height="27" style="margin-left:0px;margin-top:0px"></span></span></a><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><a href="https://www.instagram.com/voxoxofficial/" target="_blank"><span style="font-size:12pt;font-family:"Proxima Nova",sans-serif;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:26px;height:26px"><img src="https://lh3.googleusercontent.com/AFGDGW3w1Yco24kAphoI6UZW170z44YjZpLZ0rHGRfCDNyctuD4DkIYooDbxEoJxrv0NQ4TswSWA4k0FPOD6w5v_ZFadQmeoXHhP1rgeZXdoLV7n-1PGxYhi31pbte1GHYwURny8" width="26" height="26" style="margin-left:0px;margin-top:0px"></span></span></a><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><a href="https://www.linkedin.com/company/3573541/admin/" target="_blank"><span style="font-size:12pt;font-family:"Proxima Nova",sans-serif;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:26px;height:26px"><img src="https://lh6.googleusercontent.com/skcophrAnEg1jyCTXau3hMbh0GF9b1TeZ-SdROEZ0OxxHuTRKGNTS_lYIh2LIdgJ6rLTL1LMUVOlhxrHm7hxZ6p8XfYovu7xd-tXhvU1OEm4Hi6niWF6Trr7EfMFqGoLNMMeyYqk" width="26" height="26" style="margin-left:0px;margin-top:0px"></span></span></a><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><a href="https://twitter.com/Voxox" target="_blank"><span style="font-size:12pt;font-family:"Proxima Nova",sans-serif;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:26px;height:26px"><img src="https://lh6.googleusercontent.com/-IAXOgfWybf32YI5OpWoYsxhr1Iq2lvdT8a7LDpiP9IIXDxWemvF2v-dQrQC7ZPDn6eQtNQav84fAm6w39EUMfUkEq9e-mebAWCw5F1g57C3UWrnxcLoJmnPxTsSec0vI-biI8J7" width="26" height="26" style="margin-left:0px;margin-top:0px"></span></span></a></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:9pt;font-family:"Helvetica Neue",sans-serif;color:rgb(153,153,153);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">The information contained herein is confidential and privileged information or work product intended only for the individual or entity to whom it is addressed. Any unauthorized use, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, please notify me immediately.</span></p></span></div></div></div></div></div></div></div></div></div></div></div></div></div>