Kubernetes and Function-as-a-Service (FaaS) have solved most of the challenges of dealing with stateless applications. But when it comes to handling state, it quickly becomes someone else's problem: "just put it in a database". Because of that, we have struggled with the same issues of data consistency and complex failure semantics for the past decade. For stateful applications, we are still far from the smooth development and operations experience promised with the rise of serverless.
Stateful Functions is a new pattern to solve this problem. It uses containerized, event-driven functions with a stream processor (Apache Flink), not a database, to manage the state and handle the messaging between functions. This talk will provide a quick overview of Stateful Functions and touch on how this simple framework solves the problem of consistency and failure semantics (within and across functions) while staying true to the serverless experience.
Marta is a Developer Advocate at Ververica (formerly data Artisans) and a contributor to Apache Flink. After finding her mojo in open source, she is committed to making sense of Data Engineering through the eyes of those using its by-products. Marta holds a Master’s in Biomedical Engineering, where she developed a particular taste for multi-dimensional data visualization, and previously worked as a Data Warehouse Engineer at Zalando and Accenture.