DEVOURED
Prefect just bought Dagster, another big Airflow rival — and it's not a data pipeline story
Prefect is acquiring rival orchestrator Dagster, shifting their collective focus from simple data pipelines to the complex orchestration of AI agentic workflows.
What: Prefect CEO Jeremiah Lowin announced the acquisition of Dagster. The deal keeps both products, pricing, and roadmaps intact while folding Dagster's outcome-tracking and Prefect's execution engines into a single company. About 40 Dagster staff will join Prefect.
Why it matters: The merger signals that data pipeline companies see 'agentic orchestration'—defining and verifying agent goals—as the next major market opportunity, effectively positioning their tools as the control plane for autonomous AI systems.
Deep dive
- Strategy shift: The combined organization plans to focus on the 'agentic lifecycle,' using Dagster to define goals and Prefect to handle execution.
- FastMCP: Prefect is integrating its FastMCP framework, which allows developers to connect AI agents to external tools using Python functions via the Model Context Protocol.
- Leadership changes: Dagster founder Nick Schrock is exiting the company, while current CEO Pete Hunt will transition to a strategic advisor role.
- Competitive landscape: By uniting, Prefect and Dagster aim to offer a more credible alternative to the incumbent, Apache Airflow.
Decoder
- Orchestrator: A system that manages and coordinates the execution, dependencies, and scheduling of data tasks or software processes.
- Model Context Protocol (MCP): An open standard developed by Anthropic that allows AI models to safely interface with external data sources and tools through standardized connectors.
Original article
Full article content is not available for inline reading.
Explore all 56 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi