Data pipelines

data-pipelines · Data engineering and storage · skill

Also known as: data pipelines, pipelines, storage pipelines, retrieval pipeline, pipeline tooling, working pipeline, data workflows.

Narrower concepts

• dbt
• ETL
• Feature pipelines
• Spark / PySpark

Also covered in

• Data pipeline orchestration with Airflow and Dagster
• Large-scale data pipelines with Spark and PySpark

Pathways that reach it

• AI forward deployed engineer
• MLOps / ML platform engineer