Streamlining Distributed Stream Processing with SuperChief
On April 27th, Heavybit member company Librato held their SF Metrics Meetup at our San Francisco Clubhouse. Below is a video of Librato Data Engineer Ray Jenkins’ talk on distributed stream processing with SuperChief.
Distributed stream processing is all about gaining actionable insight from high volumes of data in near real-time. Stream processing is complex so many people look to frameworks for help. Last October Librato went in the other direction, moving from Apache Storm to an In-House distributed stream processing system named SuperChief.
Ray discusses the experience of moving from Apache Storm to SuperChief. He talks about some of the challenges Librato faced with Storm and the motivation to move away from frameworks. He covers the design and implementation of SuperChief, the benefits of this new approach and the direction SuperChief is going in the future.
Sign up here to attend the next SF Metrics Meetup, and check the Heavybit events page to attend other great developer focused events.
Subscribe to Heavybit Updates
You don’t have to build on your own. We help you stay ahead with the hottest resources, latest product updates, and top job opportunities from the community. Don’t miss out—subscribe now.
Content from the Library
Data Council 2025: The Data Science & Algorithms Track with Sean Taylor and Jesse Robbins
Heavybit is thrilled to be sponsoring Data Council 2025, and we invite you to join us in Oakland from Apr 22-24 to experience 3...
How to Create Data Pipelines
How to Create Data Pipelines Introduction to Data Pipelines In today’s data-driven world developers and product managers rely...
Data Council 2025: The Databases Track with Sai Krishna Srirampur and Craig Kerstiens
Heavybit is thrilled to be sponsoring Data Council 2025, and we invite you to join us in Oakland from Apr 22-24 to experience 3...