You are viewing content from a past/completed QCon

Presentation: A Whirlwind Overview of Apache Beam

Track: Real-world Data Engineering

Location: Cyril Magnin III

Duration: 10:35am - 10:45am

Day of week: Wednesday

Share this on:

Abstract

Apache Beam offers a novel programming model for data processing with two major distinctive features: full unification of batch and streaming, and portability across different runners and different languages.
We give a quick overview of the fundamentals of the Beam programming model, and an even quicker overview of the project's place in the data processing ecosystem and its future directions.

Speaker: Eugene Kirpichov

Cloud Dataflow Staff SE @Google

Eugene Kirpichov is a Staff Software Engineer on the Cloud Dataflow team at Google, where he works on the Apache Beam programming model and APIs. Previously, he worked on Cloud Dataflow’s autoscaling and straggler elimination techniques. Eugene is interested in programming language theory, data visualization, and machine learning.

Find Eugene Kirpichov at

2019 Tracks

  • Groking Timeseries & Sequential Data

    Techniques, practices, and approaches around time series and sequential data. Expect topics including image recognition, NLP/NLU, preprocess, & crunching of related algorithms.

  • Deep Learning in Practice

    Deep learning use cases around edge computing, deep learning for search, explainability, fairness, and perception.