Loading…
This event has ended. Visit the official site or create your own event on Sched.
Back To Schedule
Wednesday, October 5 • 10:00am - 10:50am
Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Kafka @PayPal

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Akka Streams and its amazing handling of stream back-pressure should be no surprise to anyone. But it takes a couple of use cases to really see it in action - especially use cases where the amount of work increases as you process make you really value the back-pressure.

This talk takes a sample web crawler use case where each processing pass expands to a larger and larger workload to process, and discusses how we use the buffering capabilities in Kafka and the back-pressure with asynchronous processing in Akka Streams to handle such bursts.

In addition, we will also provide some constructive “rants” about the architectural components, the maturity, or immaturity you’ll expect, and tidbits and open source goodies like memory-mapped stream buffers that can be helpful in other Akka Streams and/or Kafka use cases.
Speakers
avatar for Anil Gursel

Anil Gursel

Software Engineer, PayPal
Anil Gursel has been working on the JVM since 2004. His current focus is to implement reactive applications using Scala and Akka. He is a Software Engineer at PayPal’s Infrastructure team where he helps teams build highly scalable, low latency applications. Anil is a big advocate... Read More →
avatar for Akara Sucharitakul

Akara Sucharitakul

Principal MTS, Architect, PayPal
Akara Sucharitakul founded project squbs (pronounced s-cubes) for Internet scale Akka productionalization. He works in the PayPal infrastructure team, on both squbs and messaging. Akara is a 20 year veteran of the JVM from its very early days and of a veteran of Sun for 15 years... Read More →

Wednesday October 5, 2016 10:00am - 10:50am CDT
Texas Ballroom
  Conference Session

Attendees (74)