Dagster
Asset-centric orchestration for data and ML pipelines
Dagster is profiled here as a DevOps tool for engineering teams. Read about features, pricing, and how it compares to related options in the tools directory.
Description
Dagster is an open-source orchestrator created in 2018 by GraphQL co-creator Nick Schrock and developed by Dagster Labs. It models pipelines as the data assets they produce, so lineage, freshness, and quality checks attach directly to the tables and models a team actually cares about. Dagster+ adds a managed control plane with branch deployments and cost insights. The asset catalog doubles as documentation, giving analysts a searchable view of every table, its owner, and its freshness status.
Key Capabilities:
Software-defined assets with built-in lineage and cataloging
Declarative automation through schedules, sensors, and freshness policies
Asset checks for in-pipeline data quality validation
First-class dbt integration mapping models to assets
Branch deployments for testing pipeline changes in isolation
Apache 2.0 license with the managed Dagster+ platform
Alternative tools
- Apache Airflow
The most widely deployed open-source workflow orchestrator
- Coolify
Self-hosted deployment platform for any server
- Netlify
Git-driven platform for deploying modern web frontends
- Backblaze B2
Low-cost S3-compatible cloud object storage
- Cloudflare R2
S3-compatible object storage with zero egress fees
- Keycloak
Self-hosted identity and access management server