Data Engineering & Analytics¶
Curated data engineering, analytics and business intelligence tools: pipelines, orchestration, transformation, warehouses and dashboards.
21 hand-picked resources
Every link on this page was checked in November 2026. Know a great project that is missing? Suggest it on GitHub or read the contribution guide.
Orchestration & pipelines¶
- Apache Airflow - Platform to author, schedule and monitor workflows.
- Dagster - Orchestration platform for data assets.
- Prefect - Workflow orchestration framework for resilient data pipelines.
- Airbyte - Data integration platform with hundreds of connectors.
- dlt - Python library to load data into well-structured datasets.
- Kestra - Event-driven declarative orchestration platform.
Processing & transformation¶
- dbt Core - Transform data in your warehouse using SQL.
- Apache Spark - Unified engine for large-scale data analytics.
- Apache Kafka - Distributed event streaming platform.
- Apache Flink - Stream processing framework.
- Great Expectations - Data quality and validation framework.
BI & dashboards¶
- Apache Superset - Modern data exploration and visualization platform.
- Metabase - The simplest way to get analytics and BI for your company.
- Grafana - Dashboards for metrics, logs and business data.
- Evidence - Business intelligence as code with SQL and Markdown.
- Lightdash - Open-source BI tool built on dbt.
Learn data¶
- Data Engineering Zoomcamp - Free 9-week data engineering course.
- Awesome Data Engineering - Curated list of data engineering tools.
- Data Engineer Handbook - Links to everything you need to learn data engineering.
- Awesome Public Datasets - High-quality open datasets by topic.
- Awesome BI - Actually awesome business intelligence tools.