This event has ended. Visit the official site or create your own event on Sched.
Back To Schedule
Tuesday, October 4 • 4:30pm - 5:20pm
Reliability at Scale: Processing the Twitter Firehose

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Kafka is core to Twitter's historical data products, offering access to every tweet since 2006. Learn how we reliably consume and process thousands of messages per second, serving Twitter's realtime and historical data APIs without skipping a beat.

To learn how we use Kafka to serve varying business needs, we'll trace the path of a tweet through our entire architecture, focusing on the reliability of that path. We'll discuss how our architecture has evolved over the years to respond to business needs and technological changes as well as lessons learned keeping this system flowing.

avatar for Ryan Tanner

Ryan Tanner

Software Engineer, Twitter
Ryan is a software engineer with Twitter's data products organization in Boulder, offering commercial access to both realtime and historical Twitter data. He has spent most of his career working with Scala and has worked with multiple startups looking to leverage Akka and other reactive... Read More →

Tuesday October 4, 2016 4:30pm - 5:20pm CDT
Zilker Ballroom 3+4