Loading…
This event has ended. Visit the official site or create your own event on Sched.
View analytic

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Tuesday, October 4
 

8:00am

Registration and Breakfast
Tuesday October 4, 2016 8:00am - 9:00am
Zilker Ballroom 1+2

9:00am

bla bla microservices bla bla: Director’s Cut
Everyone is talking about microservices, but there is more confusion than ever about what the promise of microservices really means and how to deliver on it. In this talke we will explore microservices from first principles, distilling their essence and putting them in their true context: distributed systems.

We will start by examining individual microservices and explaining why it is important to adhere to the core traits of isolation, single responsibility, autonomy, exclusive state, asynchronous message-passing, and mobility. But what many people forget is that microservices are collaborative by nature and only make sense as systems. It is in between the microservices that the most interesting and rewarding, but also challenging, problems arise—here we are entering the world of distributed systems.

Distributed systems are inherently complex, and we enterprise developers have been spoiled by centralized servers for too long to easily understand what this really means. Slicing an existing system into various REST services and wiring them back together again with synchronous protocols and traditional enterprise tools—designed for monolithic architectures—will set you up for failure. What we need in order to build resilient, elastic, and responsive microservices-based systems is to embrace microservices as systems and re-architect them from the ground up using reactive principles.

Speakers
avatar for Jonas Bonér

Jonas Bonér

Founder & CTO, Lightbend
Jonas Bonér is Founder and CTO of Lightbend, inventor of the Akka project, co-author of the Reactive Manifesto and a Java Champion.


Tuesday October 4, 2016 9:00am - 9:50am
Zilker Ballroom 3+4

10:00am

Reactive Distributed Systems for Streaming Big Data, Analytics & ML

Being reactive in distributed systems is critical, but what does that really look like at scale with Terabytes or Petabytes of data ingestion per day, or what does it mean in applications and deployment architecture? 

There is a need to simplify. How can we build resilient, self healing systems that run at massive scale which don't lose data, support rigorous requirements, in the chaos of big data, partial failures, split brain, and eventual consistency? How would you build awareness and intelligence into your systems if 'everything fails all the time' was a starting point?

This talk looks at the problems differently, with reactive strategies and technologies that collaborate and how they help achieve more stable, self-aware systems. 

 Helena has been building large-scale, reactive, distributed cloud-based systems for many years, distributed big data systems for the last four, choosing Scala, Akka and Kafka for the core of all. She will discuss simplification of big data architecture, data flows, and a collaborative set of supporting technologies.


Speakers
avatar for Helena Edelson

Helena Edelson

Distributed Systems & Big Data Engineer, Akka Contributor
Distributed Systems & Data Engineer


Tuesday October 4, 2016 10:00am - 10:50am
Texas Ballroom

10:00am

Robust Stream Processing with Apache Flink

In this hands on talk and demonstration I'll give a very short introduction to stream processing and then dive into writing code and demonstrating the features in Apache Flink that make truly robust stream processing possible.  We'll focus on correctness and robustness in stream processing.

During this live demo we'll be developing a realtime analytics application and modifying it on the fly based on the topics we're working though.  We'll exercise Flink's unique features, demonstrate fault-recovery, clearly explain and demonstrate why Event Time is such an important concept in robust stateful stream processing and talk about and demonstrate the features you need in a stream processor to do robust stateful stream processing in production.

We'll also use a realtime analytics dashboard to visualize the results we're computing in realtime.  This will allow us to easily see the effects of the code we're developing as we go along.

Some of the topics covered will be:

  • Apache Flink
  • Stateful Stream Processing
  • Event Time vs. Processing Time
  • Fault tolerance
  • State management in the face of faults
  • Savepoints
  • Data re-processing

 


Speakers
avatar for Jamie Grier

Jamie Grier

Director of Applications Engineering, data Artisans
Jamie Grier is now Director of Applications Engineering at data Artisans where he’s extremely excited to be able to help others realize the potential of Flink in their own projects. His goal is to help others design systems to solve challenging problems in the real world. | | Jamie has been working in the field of streaming computation for the last decade. This has spanned everything from ultra high ­performance video stream... Read More →


Tuesday October 4, 2016 10:00am - 10:50am
Zilker Ballroom 3+4

10:50am

Break
Tuesday October 4, 2016 10:50am - 11:20am
Zilker Ballroom 1+2

11:20am

Reactive Polyglot Microservices with OpenShift and Vert.x
Vert.x is a framework to create reactive distributed and polyglot applications on the Java Virtual Machine.

Vert.x takes the JVM to new levels of performance yet having a small API. It lets you build scalable microservice-based applications transparently distributed and packaged as a single jar file.

Due to this simplicity, deploying and managing Vert.x applications on OpenShift is a breeze, upload your jar and Vert.x internal cluster manager will connect all your pods in single distributed network. Several examples are shown during the talk and demonstrate how Vert.x can simplify DevOps daily job when working together with OpenShift such as deployment, rolling updates, monitoring, metrics...

Speakers
avatar for Clement Escoffier

Clement Escoffier

Software Engineer, Red Hat
Who am I? That’s a good question. I had several professional lives, from academic positions to management. Currently, I’m working for Red Hat as Vert.x core developer. I touched to many domains and technologies such as OSGi, mobile app development, continuous delivery, devops… My main point of interest? Software engineering, so processes, methods, tools that make the development of software more efficient and also more fun... Read More →


Tuesday October 4, 2016 11:20am - 12:10pm
Zilker Ballroom 3+4

11:20am

Riding the Jet Streams
Java 8 introduced the Stream API as a modern, functional, and very powerful tool for processing collections of data. One of the main benefits of the Stream API is that it hides the details of iteration over the underlying data set, allowing for parallel processing within a single JVM, using a fork/join framework.
I will talk about a Stream API implementation that enables parallel processing across many machines and many JVMs.
You will learn how you can use the same API to process massive data sets across large clusters, which you already know how to do in a single JVM.
With an explanation of internals of the implementation, I will give an introduction to the general design behind stream processing using DAG (directed acyclic graph) engines and how an actor-based implementation can provide in-memory performance while still leveraging industry-wide known frameworks as Java Streams API.

Speakers
avatar for Viktor Gamov

Viktor Gamov

Senior Solutions Architect, Hazelcast
Viktor Gamov is a Senior Solution Architect at Hazelcast, the leading open-source in-memory data grid (IMDG). Viktor has comprehensive knowledge and expertise in enterprise application architecture leveraging open source technologies. He has helped leading organizations build low latency, scalable and highly available distributed systems. He is co-organizer of Princeton JUG and New York Hazelcast User Group. He is a co-author of O’Reilly's... Read More →


Tuesday October 4, 2016 11:20am - 12:10pm
Texas Ballroom

12:20pm

A Journey to Modern Apps with Containers and Microservices
Enterprises hear about the promise of application containers, but realizing meaningful business results from containers requires more than abandoning virtual machines. In order to implement containers correctly, businesses must consider the operational implications, as well as the new types of applications they want to build using microservices. In this session, Ed Hsu, Vice President of Enterprise DC/OS at Mesosphere, discusses how to capitalize on new opportunities that can accelerate your IT modernization initiatives.

Speakers
avatar for Edward Hsu

Edward Hsu

Vice President of Enterprise DC/OS, Mesosphere
Edward Hsu is Vice President of Enterprise DC/OS at Mesosphere after most recently serving as Sr. Director of Product Marketing at VMware where he oversaw the company’s first hyper-converged infrastructure appliance and software-defined data center product suites. Ed led engineering at Oracle and developed the company’s first web and workflow-based CRM offerings. Subsequently Ed was a consultant with McKinsey and Company... Read More →


Tuesday October 4, 2016 12:20pm - 1:10pm
Zilker Ballroom 3+4

1:10pm

Lunch
Tuesday October 4, 2016 1:10pm - 2:10pm
Zilker Ballroom 1+2

2:10pm

Reacting to the Movies: Reactive systems and the lessons of narrative
Groundhog Day, Die Hard, and The Dark Knight aren't just great movies. They're systems that withstand onslaughts of stress and surprise. Can studying great stories help architects and coders of reactive systems think about their work in new ways? What do superpowers tell us about scalability? What does the structure of subplots teach us about resilience? What do genre-busting movies like Rushmore, Fight Club, and Deadpool say about the future of elasticity? There are strange rules for how stories work. Those rules offer clues to building better systems.

Speakers
avatar for Steve Moore

Steve Moore

Senior Story Strategist, IBM
Steve is a Senior Story Strategist at IBM's flagship Design Studio in Austin, where he uses the tools of narrative to bring clarity to complex topics like big data analytics, open-source citizen science, and systems architecture. His career in enterprise software communication spans more than twenty years. Away from IBM, Steve is Artistic Director of Physical Plant Theater, a nationally-acclaimed theater company based in Austin. He holds an MFA... Read More →


Tuesday October 4, 2016 2:10pm - 3:00pm
Zilker Ballroom 3+4

2:10pm

Scala and the JVM as a Big Data Platform - Lessons from Apache Spark

The success of Apache Spark is bringing developers to Scala.

For Big Data, the JVM uses memory inefficiently, causing significant GC challenges. Spark's project "Tungsten" is fixing these problems with custom data layouts and code generation.
In this talk, we'll see what we've learned from Spark, ongoing improvements, and what we should do to improve Scala and the JVM for Big Data.


Speakers
avatar for Dean Wampler

Dean Wampler

Big Data Architect, Lightbend
Dean Wampler, Ph.D. is the Big Data Architect for Lightbend (formerly Typesafe), where he leads the projects building products and services centered around Kafka, Spark, Flink, Mesos, and Akka. He is the author of "Programming Scala, Second Edition", the co-author of "Programming Hive", and the author of "Functional Programming for Java Developers", all from O’Reilly. Dean is a contributor to several open source projects and the co-organizer of... Read More →


Tuesday October 4, 2016 2:10pm - 3:00pm
Texas Ballroom

3:10pm

Microservices: The danger of overhype and importance of checklists
It is a hard to argue that microservices is a new hotness in the world of software. Technical teams in seemingly all new startups are planning to develop their product using microservices, while architects in Fortune 500 are managing tireless conversations about which microservices technology is best to use for their next generation platform. The overhype of microservices is here and with that comes a danger to loose the true meaning of the word, which soon might be labeled as overrated. Before it happens, let's talk about what microservices architecture is, what it can offer, what it gets us into, what its price tag and how to create a checklist for choosing right tools that would help solve the complexity instead of sugarcoating it. 

Speakers
avatar for Katrin Shechtman

Katrin Shechtman

Enterprise Architect, Lightbend Inc.
Software Engineer with years of experience developing large platforms in C, C++, Java and Scala utilizing many different frameworks. Currently works at Lightbend as Enterprise Architect helping big enterprises embrace a world of Reactive Systems and Big Data.


Tuesday October 4, 2016 3:10pm - 4:00pm
Texas Ballroom

3:10pm

Reactive Kafka with Akka Streams
Apache Kafka is now widely adopted among modern distributed systems. In this presentation we will see how Akka Streams can add even more power to Kafka by exposing it as a reactive stream. We will see some examples of how the Reactive Kafka library can be leveraged to build a well-fitting and elegant match of partitioned, pull-based distributed log and asynchronous, backpressured streaming model.

Speakers
avatar for Krzysztof Ciesielski

Krzysztof Ciesielski

Reactive Systems Specialist, SoftwareMill
Krzysiek works in SoftwareMill where he started to develop professionally with Scala over three years ago. Passionate about functional programming and reactive systems. Krzysiek is also the creator of Reactive Kafka library, which has recently joined Akka supported projects.


Tuesday October 4, 2016 3:10pm - 4:00pm
Zilker Ballroom 3+4

4:00pm

Coffee
Tuesday October 4, 2016 4:00pm - 4:30pm
Zilker Ballroom 1+2

4:30pm

Reactive Stream processing at Netflix
Netflix customers stream over two billion hours of content each month, accounting for over a third of downstream Internet traffic during peak hours. At this scale, Netflix's systems generate and collect millions of events every second, such as request traces, streaming client activities, and system metrics. It is essential for engineers to process such data streams efficiently and reliably to support real-time monitoring and alerting, outlier detection, application diagnostics, trend prediction, and many other operations.

This talk will discuss Netflix's stream processing system a.k.a. Mantis that supports a reactive programming model, allows auto scaling, and is capable of processing millions of messages per second with configurable message delivery guarantees.

Mantis is a stream processing framework built on reactive principles using RxJava, Netty and ReactiveSocket. It provides users with the capabilities to write scalable stream processing jobs without having to worry about hard problems such as managing continuous data flow in a distributed environment or ensuring fault tolerance.

Speakers
avatar for Neeraj Joshi

Neeraj Joshi

Senior Software Engineer, Netflix
Neeraj is a Senior Software Engineer on the Netflix Edge Realtime Events team. He has over 12 years of experience in the industry building highly scalable and resilient systems. He designed and developed Scryer Netflix’s predictive autoscaling engine and is the key contributor to Netflix’s next generation stream processing system.
avatar for Nick Mahilani

Nick Mahilani

Senior Software Engineer, Netflix
Nick is a Senior Software Engineer on the Netflix Edge Realtime Events team. He has over 10 years of software engineering experience building a range of software systems from embedded routing/switching software to highly scalable distributed microservices.


Tuesday October 4, 2016 4:30pm - 5:20pm
Texas Ballroom

4:30pm

Reliability at Scale: Processing the Twitter Firehose
Kafka is core to Twitter's historical data products, offering access to every tweet since 2006. Learn how we reliably consume and process thousands of messages per second, serving Twitter's realtime and historical data APIs without skipping a beat.

To learn how we use Kafka to serve varying business needs, we'll trace the path of a tweet through our entire architecture, focusing on the reliability of that path. We'll discuss how our architecture has evolved over the years to respond to business needs and technological changes as well as lessons learned keeping this system flowing.

Speakers
avatar for Ryan Tanner

Ryan Tanner

Software Engineer, Twitter
Ryan is a software engineer with Twitter's data products organization in Boulder, offering commercial access to both realtime and historical Twitter data. He has spent most of his career working with Scala and has worked with multiple startups looking to leverage Akka and other reactive technologies.


Tuesday October 4, 2016 4:30pm - 5:20pm
Zilker Ballroom 3+4

5:30pm

Functional (and Reactive) Operations
If we were starting greenfield development of a service or web application today we would likely employ a number of practices and design choices that are known to optimise application responsiveness, resiliency, elasticity, and/or composability. Delivering our reactive applications on top of predictable infrastructure will set our project up for success.
Some of us don't have that luxury. We must provision, deploy, and operationally maintain legacy monolithic Rails web applications and HTTP APIs that are hard to refactor without introducing new bugs, poorly performing, and struggle to meet user load/peak demand. Built during a prior era of the company where fast and loose practices were rewarded, startup cowboys delivered the first set of features promptly at the expense of subsequent velocity, long-term maintainability, and high risk deployments. When living in this reality, our infrastructure must be reliable or our application needs constant babysitting, leading to on-call fatigue and high staff turnover.
The good news is there are core principles we can apply to produce more reproducible systems, failstop deployments, and consistent environment configurations to eliminate a large class of bugs inherent in legacy applications and minimize related business risks. This will be the focus of the session and applies to both greenfield and legacy cases.
Code examples given using NixOS and Haskell, but focus remains on the underlying principles.

Speakers
avatar for Susan Potter

Susan Potter

Distributed Systems Engineer, Referential Labs
Susan is a distributed systems engineer straddling technical operations and engineering helping make data and service infrastructure operationally manageable at scale. Over the last seventeen years she has worked on algorithmic trading systems, market data software, multi-tenant service oriented architecture, and continuous delivery through declarative infrastructure.


Tuesday October 4, 2016 5:30pm - 6:20pm
Texas Ballroom

5:30pm

Staging reactive data pipelines using Kafka as the backbone
At Cake Solutions, we build highly distributed and scalable systems using Kafka as our core data pipeline.

Kafka has become the de facto platform for reliable and scalable distribution of high-volumes of data. However, as a developer, it can be challenging to figure out the best architecture and consumption patterns for interacting with Kafka while delivering quality of service such as high availability and delivery guarantees. It can also be difficult to understand the various streaming patterns and messaging topologies available in Kafka.

In this talk, we present the patterns we've successfully employed in production and provide the tools and guidelines for other developers to choose the most appropriate fit for given data processing problem. The key points for the presentation are: patterns for building reactive data pipelines, high availability and message delivery guarantees, clustering of application consumers, topic partition topology, offset commit patterns, performance benchmarks, and custom reactive, asynchronous, non-blocking Kafka driver.

Speakers
avatar for Jaakko Pallari

Jaakko Pallari

Software Engineer, Cake Solutions Ltd
Jaakko is a software engineer at Cake Solutions Ltd. He is passionate about practical use of functional programming, robust software, and free and open source software. He started his career as a Java web developer, and he's currently responsible for developing a global scale IoT platform using the SMACK stack tools.
avatar for Simon Souter

Simon Souter

Software Engineer, Cake Solutions
Simon is a Scala Engineer/ Team Lead at Cake with 3 years experience building reactive solutions with the Lightbend stack and over 10 years with Enterprise Java building mission critical integration/ messaging solutions. He's currently the tech lead building out a large high volume, global and scalable IOT platform with Scala, Akka, Kafka and Cassandra on AWS with Mesos/ Marathon.


Tuesday October 4, 2016 5:30pm - 6:20pm
Zilker Ballroom 3+4

6:30pm

Welcome Reception - Sponsor Booth Crawl
Join us for cocktails and hors d oeuvres at the Welcome Reception. Visit our sponsors and you could win valuable prizes. In your registration packet will be a Passport sheet. Stop by all the sponsor booths listed and get a stamp. Once you’ve collected all the stamps, fill out your contact info and turn it into registration. We’ll hold the drawing during the last break on October 5.

Tuesday October 4, 2016 6:30pm - 7:30pm
Zilker Ballroom 1+2
 
Wednesday, October 5
 

8:00am

Registration and Breakfast
Wednesday October 5, 2016 8:00am - 9:00am
Zilker Ballroom 1+2

9:00am

Orchestrated Chaos: Applying Failure Testing Research at Scale.
Large-scale distributed systems must be built to anticipate and mitigate a variety of hardware and software failures. In order to build confidence that fault-tolerant systems are correctly implemented, an increasing number of large-scale sites practice Chaos Engineering, running regular failure drills in which faults are deliberately injected in their production system.  While fault injection infrastructures are becoming relatively mature, existing approaches either explore the space of potential failures randomly or exploit the “hunches” of domain experts to guide the search—the combinatorial space of failure scenarios is too large to search exhaustively. Random strategies waste resources testing “uninteresting” faults, while programmer-guided approaches are only as good as the intuition of a programmer and only scale with human effort. 
In this talk, I will present intuition, experience and research directions related to lineage-driven fault injection (LDFI), a novel approach to automating failure testing.  LDFI utilizes existing tracing or logging infrastructures to work backwards from good outcomes, identifying redundant computations that allow it to aggressively prune the space of faults that must be explored via fault injection.  I will describe LDFI’s theoretical roots in the database research notion of provenance, present results from the lab as well as the field, and present a call to arms for the reliability community to improve our understanding of when and how our fault-tolerant systems actually tolerate faults.

Speakers
avatar for Peter Alvaro

Peter Alvaro

Assistant Professor, UC Santa Cruz
Peter Alvaro is an Assistant Professor of Computer Science at the University of California Santa Cruz. His research focuses on using data-centric languages and analysis techniques to build and reason about data-intensive distributed systems, in order to make them scalable, predictable and robust to the failures and nondeterminism endemic to large-scale distribution. Peter is the creator of the Dedalus language and co-creator of the Bloom... Read More →


Wednesday October 5, 2016 9:00am - 9:50am
Zilker Ballroom 3+4

10:00am

Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Kafka @PayPal
Akka Streams and its amazing handling of stream back-pressure should be no surprise to anyone. But it takes a couple of use cases to really see it in action - especially use cases where the amount of work increases as you process make you really value the back-pressure.

This talk takes a sample web crawler use case where each processing pass expands to a larger and larger workload to process, and discusses how we use the buffering capabilities in Kafka and the back-pressure with asynchronous processing in Akka Streams to handle such bursts.

In addition, we will also provide some constructive “rants” about the architectural components, the maturity, or immaturity you’ll expect, and tidbits and open source goodies like memory-mapped stream buffers that can be helpful in other Akka Streams and/or Kafka use cases.

Speakers
avatar for Anil Gursel

Anil Gursel

Software Engineer, PayPal
Anil Gursel has been working on the JVM since 2004. His current focus is to implement reactive applications using Scala and Akka. He is a Software Engineer at PayPal’s Infrastructure team where he helps teams build highly scalable, low latency applications. Anil is a big advocate for Scala and Akka, and a core contributor for squbs – an open source Akka-based infrastructure by PayPal.
avatar for Akara Sucharitakul

Akara Sucharitakul

Principal MTS, Global Platform Frameworks, PayPal
Akara Sucharitakul founded project squbs (pronounced s-cubes) for Internet scale Akka productionalization. He works in the PayPal infrastructure team. Akara is a 20 year veteran of the JVM from its very early days and of a veteran of Sun for 15 years. He left his fingerprints all over industry-wide standards for testing and measuring server-side Java performance. | Akara has a lifetime passion on performance, scalability, and resiliency, and... Read More →


Wednesday October 5, 2016 10:00am - 10:50am
Texas Ballroom

10:00am

The Zen Of Erlang
A code-free presentation about the core principles and philosophies of
Erlang, explaining how the whole is greater than the sum of its parts.

This presentation takes a perspective rooted in showing the reasoning
between each of the building blocks (message-passing, isolated
processes, links and monitors, and so on), and shows how they can be
assembled together to create larger systems where interactions between
subsystems take a front seat in defining the fault tolerance of these
systems.

Speakers
avatar for Fred Hebert

Fred Hebert

Leader Member of the Technical Staff, Heroku
Fred Hebert is the author of 'Learn You Some Erlang for Great Good!', a | free online (also paid for, on paper) book designed to teach Erlang, and | of 'Erlang in Anger', a follow-up ebook about operating Erlang systems | in production. He works as a lead member of technical staff on Heroku’s | routing components, helping design, program, maintain, and operate large | scale distributed systems in the cloud, more often... Read More →


Wednesday October 5, 2016 10:00am - 10:50am
Zilker Ballroom 3+4

10:50am

Break
Wednesday October 5, 2016 10:50am - 11:20am
Zilker Ballroom 1+2

11:20am

Architecting with the Functional Paradigm for High-Performance Enterprise Applications
This session describes our experience adopting a functional programming architecture approach for large-scale, complex enterprise application delivery. We describe a software architecture approach and patterns which provide: 
  • More direct correspondence between business logic and code  
  • Decoupling of business components from each other and from architecture plumbing  
  • Testability  
  • Painless support for non-blocking execution, for high-performance 
We address delivery challenges encountered with the adoption of Scala and the Lightbend stack: 
  • Technology stack complexity  
  • Shortage of skilled Scala architects and developers with enterprise software delivery background  
  • Development, testing, and operations are much more challenging with non-blocking code than with traditional blocking code 

Speakers
avatar for Hilda Lu

Hilda Lu

Principal, Senior Technology Architect, Accenture
During her 20+ years in software development, Hilda has developed a variety of large-scale systems across several industries using Java and .NET technologies. Her experience has primarily aligned to execution architecture. Recently she has been working on a large-scale transaction-processing application for the US federal government.
avatar for Paulo Villela

Paulo Villela

Managing Director, Senior Software Architect, Accenture
Paulo is a hands-on architect passionate about software development productivity. In his more than 25 years of consulting at Accenture, Paulo has assisted clients in the US, Canada, Europe, South America, and Asia on systems development, maintenance, planning, and review projects in a variety of industries. Recent client engagements have focused on the scalability, performance, stability, and development productivity challenges of large-scale... Read More →


Wednesday October 5, 2016 11:20am - 12:10pm
Zilker Ballroom 3+4

11:20am

Stream Processing with Apache Flink in Zalando's World of Microservices
In this talk we present Zalando's microservices architecture, introduce Saiki – our next generation data integration and distribution platform on AWS and show how we employ stream processing for near-real time business intelligence.

Zalando is one of the largest online fashion retailers in Europe. In order to secure our future growth and remain competitive in this dynamic market, we are transitioning from a monolithic to a microservices architecture and from a hierarchical to an agile organization.

We first have a look at how business intelligence processes have been working inside Zalando for the last years and present our current approach - Saiki. It is a scalable, cloud-based data integration and distribution infrastructure that makes data from our many microservices readily available for analytical teams.

We no longer live in a world of static data sets, but are instead confronted with an endless stream of events that constantly inform us about relevant happenings from all over the enterprise. The processing of these event streams enables us to do near-real time business intelligence. In this context we have evaluated Apache Flink vs. Apache Spark in order to choose the right stream processing framework. Given our requirements, we decided to use Flink as part of our technology stack, alongside with Kafka and Elasticsearch.

With these technologies we are currently working on two use cases: a near real-time business process monitoring solution and streaming ETL.

Monitoring our business processes enables us to check if technically the Zalando platform works. It also helps us analyze data streams on the fly, e.g. order velocities, delivery velocities and to control service level agreements.

On the other hand, streaming ETL is used to relinquish resources from our relational data warehouse, as it struggles with increasingly high loads. In addition to that, it also reduces the latency and facilitates the platform scalability.

Finally, we have an outlook on our future use cases, e.g. near-real time sales and price monitoring. Another aspect to be addressed is to lower the entry barrier of stream processing for our colleagues coming from a relational database background.

Speakers
avatar for Javier Lopez

Javier Lopez

Big Data Engineer, Zalando
Javier is a Colombian Engineer from the National University of Colombia. During his bachelor studies he focused on Software Engineering, Telecommunication technologies and Business Intelligence. After working more than 7 years as Software Engineer in different industries (Education, Banking, Entrepreneurship, among others) he decided to change career paths and started working as a Business Intelligence Engineer. Javier has worked 4+ years in... Read More →
avatar for Mihail Vieru

Mihail Vieru

Big Data Engineer, Zalando
Mihail is passionate about designing and implementing highly scalable, performant and robust data processing solutions. He enjoys continuously learning and working with cutting edge technologies. Mihail earned a Master's degree from the Humboldt University of Berlin, Germany, where he specialized on Big Data Analytics Systems, Data Warehousing and Software Engineering. As part of his studies, he worked on an optimization component for... Read More →


Wednesday October 5, 2016 11:20am - 12:10pm
Texas Ballroom

12:20pm

Distributed stream processing with Apache Kafka
A modern business operates 24/7 and generates data continuously. Shouldn’t we process it continuously too?

A rich ecosystem of real-time data-processing frameworks, tools and systems has been forming around Apache Kafka that allows data to be processed continuously as it occurs. Jay Kreps will introduce Kafka and explain why it has become the de facto standard for streaming data. He will draw on practical experience building stream-processing applications to discuss the difference between architectures and the challenges each presents. Jay will then outline Kafka Streams, which offers new stream processing functionality in Kafka, and explain how it helps tame some of the complexity in real-time architectures.

Speakers
avatar for Jay Kreps

Jay Kreps

Co-founder and CEO, Confluent
Jay Kreps is the co-founder and CEO of Confluent, a company backing the popular Apache Kafka messaging system. Prior to founding Confluent, he was the lead architect for data infrastructure at LinkedIn. He is among the original authors of several open source projects including Project Voldemort (a key-value store), Apache Kafka (a distributed messaging system) and Apache Samza (a stream processing system).


Wednesday October 5, 2016 12:20pm - 1:10pm
Zilker Ballroom 3+4

1:10pm

Lunch
Wednesday October 5, 2016 1:10pm - 2:10pm
Zilker Ballroom 1+2

2:10pm

Monolith to reactive microservices
In this talk, we will review an experience of rearchitecting and migrating a system that appeared reactive and microservice-based, but was in fact a monolith with RPC calls to a truly reactive architecture.

The migration work had to be done without causing disruption to the current system, and without taking time to rewrite the system. The result is a biometric computer vision system with a distributed domain in Akka / Scala with storage in Apache Cassandra, with the computer vision components in OpenCV in C++, connected with RabbitMQ and with batch analytics code in Apache Spark.

This talk will show the architectural and code smells that were the result of half-harted reactive implementation and the way to address them, but also the impact of the changes on privacy and security of the stored biometric information.

Speakers
avatar for Jan Machacek

Jan Machacek

Chief Technology Officer, Cake Solutions
"I help companies achieve exceptional growth and success through use of modern computing technologies; specifically large-scale machine learning and big data systems, particularly those that interact with IoT, wearables, mobiles as well as modern web applications. My experience and expertise allows me to advise on future technical strategies. | | Naturally, I am a passionate technologist; I have hands-on experience with delivering large-scale... Read More →


Wednesday October 5, 2016 2:10pm - 3:00pm
Texas Ballroom

2:10pm

Reactive Integrations with Akka Streams that Just Work!
Since its stable release earlier this year, Akka Streams is quickly becoming the de facto standard integration layer between various Streaming systems and products.

This comes from the Reactive Streams initiative in part, which has been long led by Lightbend and others, allowing multiple streaming libraries to inter-operate between each other in a performant and resilient fashion, providing back-pressure all the way. But perhaps even more so thanks to the various integration drivers that have sprung up in the community and the Akka team—including drivers for Kafka, Cassandra, Streaming HTTP, Websockets and much more.

In this talk we'll explore what and why Reactive integration for streaming matters, how Akka Streams makes it trivial, and what the future holds in this landscape.

Speakers
avatar for Johan Andrén

Johan Andrén

Developer, Lightbend
Johan is one of the Akka Team developers at Lightbend, keeping the actors acting, the cluster clustered and the streams streaming. He's a big Scala fan and has been working with tech on the JVM platform the last 10 years. He's a co-organizer of Scala Usergroup Stockholm. Talk to him about Akka things - Actors, Streams, distributed systems (obviously), Scala, extreme music, bicycle accidents and bouldering, or anything you like actually.
avatar for Konrad Malawski

Konrad Malawski

Akka Team, Lightbend
Konrad is a late-night passionate dev living by the motto "Life is Study!", working on the Akka project at Lightbend. He also contributed most of the current Reactive Streams TCK, and maintains various other open source projects. His favourite discussion topics range from distributed systems through performance tuning, benchmarking and capybaras. He has founded and run multiple user groups (Java, Scala, Computer Science, ...), and is co-leading... Read More →


Wednesday October 5, 2016 2:10pm - 3:00pm
Zilker Ballroom 3+4

3:10pm

Monolith to reactive - it's all about architecture
There are plenty of reactive technologies out there, but these are only the building blocks for building reactive systems, using these technologies to build a system does not necessarily make the system reactive. A reactive system will have a fundamentally different architecture to the traditional monolith found in the enterprise.

In this presentation we take a hands on look at how the architecture of a system, including the flow of data, the types of communication used, and the way the system is broken down into components, will need to change as you decompose a monolith into a reactive microservice based system.

Speakers
avatar for James Roper

James Roper

Tech Lead, Lightbend
James is the tech lead of Lagom working for Lightbend. He has experience both in enterprise monoliths and web scale microservices, and is passionate about helping developers understand how their systems must evolve to meet the increasing demands placed on software systems today.


Wednesday October 5, 2016 3:10pm - 4:00pm
Zilker Ballroom 3+4

3:10pm

Schema upgrades in a continuous delivery environment
You have a 24/7/365 environment up and running with dozens of services and dozens on instances for each. Everything is going well. Then, a new feature is required and it requires change to one of your datastores. Since you have a few dozen instances of that service running, you need to perform a rolling upgrade. In this talk, we will discuss some strategies to allow such upgrades to be possible.

Speakers
avatar for David Buschman

David Buschman

Technical Lead, Timeli, Inc.
Dave Buschman is the Technical Lead for the Colorado-based startup company Timeli ( timeli.io ).  We operate in the Meter and Sensor Data collection and analytics space.  His experience in the Java Enterprise SaaS space lead him to move to Scala a few years back, where he is now enjoying the new technology landscape of streaming data and analytics.  Dave is also the organizer for the Denver Scala Users Group Meetup, so if you are close... Read More →


Wednesday October 5, 2016 3:10pm - 4:00pm
Texas Ballroom

4:00pm

Coffee
Wednesday October 5, 2016 4:00pm - 4:30pm
Zilker Ballroom 1+2

4:30pm

Embracing Streams…Everywhere

“I don’t need stream processing because I don’t have streaming data.” - Anonymous
In general people relate to streams as data models which are naturally streaming (infinite asynchronous messages) or relate to realtime big data processing. In this talk Nitesh Kant, will try to break this myth by emphasizing the fact that streams exists everywhere, be it data read from sockets, protocols like HTTP or microservice composition. He will explain how extending this ubiquitous interaction model into applications can result in simpler, resilient and maintainable systems.
You will learn, how to start thinking “streaming first” through concrete examples and how adopting this mental model makes writing application easier.


Speakers
avatar for Nitesh Kant

Nitesh Kant

Senior Software Engineer, Netflix
Nitesh Kant is an engineer on the Edge Platform team at Netflix. He works on the reactive networking infrastructure of Netflix comprising of RxNetty (https://github.com/ReactiveX/RxNetty) and ReactiveSocket (http://reactivesocket.io/). Edge platform team at Netflix is responsible for creating a highly available, large scale, globally distributed edge tier for Netflix that serves as the backbone for the infrastructure serving over 80 Million... Read More →


Wednesday October 5, 2016 4:30pm - 5:20pm
Texas Ballroom

4:30pm

The Demo Gods are (not) on our side!
In this presentation the ConductR team will demonstrate a number of real-world scenarios that can occur with distributed systems. The demonstrations will be live and include a split brain scenario along with auto scaling based on demand. Things will no doubt go wrong so come and enjoy four guys making fools of themselves!

Speakers
avatar for Ed Callahan

Ed Callahan

Senior Software Engineer, Lightbend, Inc
Edward is a senior software engineer with Lightbend where he gets to build and deploy reactive applications. Previously he was a technical lead at VMware's SpringSource division. Ed has been contributing to open source software for years and has been hacking in the JVM, DOM and elsewhere for even longer. He studied at Worcester Polytechnic Institute and Northeastern University, and is the author of Easy Web Development with WaveMaker.
avatar for Hunt Christopher

Hunt Christopher

Technical Lead, Production Suite, Lightbend
The ConductR team comprises of Ed Callahan, Felix Satyaputra, Markus Jura and Christopher Hunt. These four guys will be providing a joint presentation on the resiliency of ConductR bringing together their collective experiences of having developed and managed real-life distributed systems.
avatar for Markus Jura

Markus Jura

Senior Software Engineer, Lightbend
Markus Jura is a senior software engineer at Lightbend. He has more than 14 years of experience managing and developing software solutions in Java and Scala. He became passioned about programming in Scala, Akka and Play ever since he got introduced to these technologies. From that point on Markus enjoys to share his experience as a speaker on various conferences. He is also the co-founder and former CTO of Y-Combinator funded startup.


Wednesday October 5, 2016 4:30pm - 5:20pm
Zilker Ballroom 3+4

5:30pm

Implementing an akka-streams materializer for big data
Akka Streams provides a tremendously flexible architecture to build reactive pipelines that can be imported, exported and otherwise composed as partial DAGs. Its current, default implementation is ActorMaterializer which provides reactive streams across actors within a single JVM. 
Here we show how we implemented a GearpumpMaterializer which distributes reactive streams across a set of remote workers on the Apache Gearpump platform. We discuss how this was implemented and a number of challenges we faced with specific GraphStages and their semantics. Additional we cover how different materializer implementations can interoperate together to materialize different parts of the pipeline. We show that the changes we introduced internally within Akka Streams will enable other implementations of akka stream materializers and suggest a template based on our implementation. We will contribute the Gearpump materializer as open source to https://github.com/akka/akka-stream-contrib or make it available as part of an upcoming Apache Gearpump release.

Speakers
avatar for Kam Kasravi

Kam Kasravi

Senior Software Engineer, Intel Corp
Kam is a real time streaming architect developing analytic pipelines that integrate into Intel's Trusted Analytics Platform. He is an avid fan of akka, scala and platforms based on these architectures with past roles within eBay, Paypal and Yahoo.


Wednesday October 5, 2016 5:30pm - 6:20pm
Texas Ballroom

5:30pm

Netty - One Framework to rule them all
Netty is one of the best known and most widely used (if not the most widely used) asynchronous network application frameworks for the JVM.
This talk will show you how Netty itself works and explain why some  design choices were made. Beside this it will include war stories about
the many JVM-related challenges the Netty community has faced during Netty development and explain what action were taken to workaround these.

Speakers
avatar for Norman Maurer

Norman Maurer

Senior Software Engineer, Cloud Infrastructure Engineering


Wednesday October 5, 2016 5:30pm - 6:20pm
Zilker Ballroom 3+4