Back to Devoured - November 16, 2026
DEVOURED
Data governance that actually runs

Data governance that actually runs

Data Data Engineer Things
Effective data governance is being achieved by treating policy as code, enforced automatically across an open-source stack including Airflow 3, dbt, and DataHub.
What: The article proposes a "governance-as-code" stack using MinIO, Postgres, Airflow 3, and dbt, with automated CI/CD checks for data contracts, lineage, and access controls.
Why it matters: Governance fails when it relies on manual documentation; embedding it directly into the CI/CD pipeline ensures policy adherence without slowing development.
Takeaway: Integrate data contract enforcement and automated lineage checks into your CI pipeline using tools like DataHub or dbt.
Deep dive
  • Governance must be automated via CI to remain relevant.
  • Data contracts serve as the source of truth for schema and ownership.
  • The stack uses MinIO for storage and Postgres for operational data.
  • Airflow 3 and dbt handle pipeline orchestration and transformation.
  • DataHub provides lineage, while Apache Ossie and Superset handle semantic definitions and reporting.
  • AI assistants (MCP-enabled) can be used to navigate this governed environment.
Decoder
  • Governance-as-code: Managing and enforcing data policies through automated scripts and pipeline configurations rather than manual audits.
  • Data contract: A formal agreement between data producers and consumers that defines the schema, semantic meaning, and quality expectations of data.
Original article

Governance-as-code turns policy into checks across a local, open-source stack: MinIO for S3-like intake; Postgres for operations and warehousing; Airflow 3 and dbt for pipelines; DataHub, Apache Ossie, and Superset for catalog, semantic definitions, and dashboards; and MCP-connected AI assistants. CI enforces contracts, ownership, masking, lineage, consumer-impact approval, and least-privilege access before production.

Explore all 69 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi