Data Engineering Concepts
Pipelines, ETL/ELT, batch vs streaming, lakes and warehouses.
Intermediate
This is an overview — pick a sub-topic below.
Sub-topics (4)
ETL and ELT
Extract–Transform–Load vs Extract–Load–Transform: where the cleaning happens.
Easy♥ 0🔖 0💬 0
Data Pipelines
Automated chains of steps that move and transform data on a schedule or trigger.
Intermediate♥ 0🔖 0💬 0
Batch vs Stream Processing
Process data in scheduled chunks, or continuously as events arrive.
Intermediate♥ 0🔖 0💬 0
Data Lakes, Warehouses and Lakehouses
Where analytical data lives: raw files (lake), structured SQL tables (warehouse), or both (lakehouse).
Intermediate♥ 0🔖 0💬 0
Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.
Discussion (0)
Sign in or join free to ask questions and discuss this topic.