Projects for Data Engineers
Data engineering projects are hands-on builds that combine the roadmap's skills into portfolio work: a batch ELT pipeline with dbt and an orchestrator, a streaming pipeline from events to a dashboard, an Iceberg lakehouse with quality checks, and change data capture from Postgres into a warehouse.
Stage: Capstone and Career · Part of the Data Engineer roadmap · Last reviewed 19 November 2026
What to learn in Projects
- Build an end-to-end ELT pipeline orchestrated on a daily schedule
- Stream events through Kafka into a table that a dashboard reads
- Add automated quality checks that fail a pipeline on bad data
- Replicate a Postgres table into a warehouse using CDC
- Write a README that explains architecture choices and trade-offs
Projects interview questions
How should you present a data engineering project to an interviewer?
Start with the problem and data volume, then show an architecture diagram, key design choices and what you did about failure, quality and cost. Be ready to explain trade-offs, such as why batch over streaming, and to show tests and a working repo.
What makes a pipeline project look production-ready?
Idempotent reruns, automated tests, retries and alerts, configuration kept outside code, infrastructure defined as code and a README with a runbook. Small touches like data freshness checks and documented schemas show you have thought beyond the happy path.
Where Projects fits in the Data Engineer roadmap
Projects belongs to the Capstone and Career stage (advanced level), which takes about 7 hours. Build a platform.
Other units in this stage
Back to the full Data Engineer roadmap