Curriculum Pathway

Apache Beam Learning Roadmap

Follow our structured pathway to master Apache Beam from scratch. Choose any module below to dive into code walkthroughs, visual DAG diagrams, and in-browser sandboxes.

125+Lessons

9Core Modules

100%Free & Open

Interactive Hands-On Sandbox

Put your knowledge to the test directly inside the browser

Don't just read about data pipelines—build them. Write Beam scripts in our Playground or challenge yourself on 40 sandbox exercises evaluated via WebAssembly.

1. Fundamentals

14 lessons

Introduction to Apache Beam Why Apache Beam?Batch vs Streaming Beam Programming Model Apache Beam Architecture Installation & Environment Setup Creating Your First Beam Pipeline Pipeline Basics Project Structure Pipeline Options Pipeline Runners Direct Runner Dataflow Runner (Introduction)Running Your First Pipeline

2. Core Concepts

12 lessons

Pipeline PCollection PTransform Create Transform Read Transform Write Transform Type Hints Coders Serialization Side Inputs Side Outputs Tagged Outputs

3. Transformations

18 lessons

Map FlatMap Filter Distinct Flatten Partition Count Mean Top Sample GroupByKey CombinePerKey CombineGlobally Custom CombineFn DoFn ParDo CoGroupByKey Aggregations

4. Windowing

16 lessons

Why Windowing?Windowing Overview Event Time Processing Time Timestamp Assignment Global Window Fixed Windows Sliding Windows Session Windows Custom Windows Watermarks Allowed Lateness Late Data Triggers Trigger Types Accumulation Modes

5. Streaming

13 lessons

Streaming Basics Bounded vs Unbounded Pub/Sub Streaming Kafka Streaming Handling Out-of-Order Events Deduplication Streaming Aggregations Stateful Processing State API Timers Fault Tolerance Exactly Once Processing Checkpointing Concepts

7. Google Cloud Dataflow

11 lessons

Introduction to Dataflow Dataflow Architecture Direct Runner vs Dataflow Runner Pipeline Templates Flex Templates Runtime Parameters Monitoring Jobs Logs Autoscaling Worker Configuration Best Practices

8. Beam Patterns & Design

8 lessons

Composite Transforms Reusable Transforms Error Handling Patterns Dead Letter Queue (DLQ)Side Input Patterns Join Patterns Streaming Design Patterns Pipeline Design Patterns

9. Production & Best Practices

13 lessons

Pipeline Performance Tuning Cost Optimization Debugging Pipelines Logging & Monitoring Metrics Testing Beam Pipelines Unit Testing Integration Testing Deployment Strategies CI/CD for Beam Common Production Issues Scaling Pipelines Security Best Practices