Data Analysis and Data Engineering

From cleaning a CSV to running production data pipelines: concepts, processing engines, orchestration and data quality.

Easy

This is an overview — pick a sub-topic below.

Sub-topics (5)

The everyday steps of turning raw data into insight.

Easy♥ 0🔖 0💬 0

Pipelines, ETL/ELT, batch vs streaming, lakes and warehouses.

Intermediate♥ 0🔖 0💬 0

Spark, Flink, Beam, Kafka and DuckDB.

Intermediate♥ 0🔖 0💬 0

Schedule and monitor pipelines: Airflow, Prefect, Dagster, Luigi and Kedro.

Intermediate♥ 0🔖 0💬 0

dbt, Great Expectations, Pandera, Soda, Feast and table formats.

Intermediate♥ 0🔖 0💬 0

Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.