Loading…
This event has ended. Visit the official site or create your own event on Sched.
View analytic
Tuesday, October 4 • 5:30pm - 6:20pm
Staging reactive data pipelines using Kafka as the backbone

Sign up or log in to save this to your schedule and see who's attending!

At Cake Solutions, we build highly distributed and scalable systems using Kafka as our core data pipeline.

Kafka has become the de facto platform for reliable and scalable distribution of high-volumes of data. However, as a developer, it can be challenging to figure out the best architecture and consumption patterns for interacting with Kafka while delivering quality of service such as high availability and delivery guarantees. It can also be difficult to understand the various streaming patterns and messaging topologies available in Kafka.

In this talk, we present the patterns we've successfully employed in production and provide the tools and guidelines for other developers to choose the most appropriate fit for given data processing problem. The key points for the presentation are: patterns for building reactive data pipelines, high availability and message delivery guarantees, clustering of application consumers, topic partition topology, offset commit patterns, performance benchmarks, and custom reactive, asynchronous, non-blocking Kafka driver.

Speakers
avatar for Jaakko Pallari

Jaakko Pallari

Software Engineer, Cake Solutions Ltd
Jaakko is a software engineer at Cake Solutions Ltd. He is passionate about practical use of functional programming, robust software, and free and open source software. He started his career as a Java web developer, and he's currently responsible for developing a global scale IoT platform using the SMACK stack tools.
avatar for Simon Souter

Simon Souter

Software Engineer, Cake Solutions
Simon is a Scala Engineer/ Team Lead at Cake with 3 years experience building reactive solutions with the Lightbend stack and over 10 years with Enterprise Java building mission critical integration/ messaging solutions. He's currently the tech lead building out a large high volume, global and scalable IOT platform with Scala, Akka, Kafka and Cassandra on AWS with Mesos/ Marathon.


Tuesday October 4, 2016 5:30pm - 6:20pm
Zilker Ballroom 3+4

Attendees (51)