DataHub
Open-source metadata platform for financial data engineering β real-time data discovery, column-level lineage, and data observability for modern data stacks in finance.
DataHub is an open-source metadata platform originally developed by LinkedIn and now governed by the Linux Foundation, widely adopted by financial institutions for real-time data discovery, column-level lineage, and data observability. Its real-time ingestion architecture captures metadata changes as they happen, providing finance teams with up-to-date visibility into their data landscape. Column-level lineage automatically traces how financial metrics are calculated from source systems through transformations to final reports, creating the audit trail required by financial regulators. DataHub's domain-based governance allows financial institutions to organize data by business domain (risk, trading, compliance) with role-based access control. With strong integrations for dbt, Airflow, Spark, Kafka, and modern data stacks, DataHub is the preferred metadata platform for data engineering teams in financial institutions that want open-source flexibility and technical depth.
Key Features
- βOpen-source metadata platform with real-time ingestion
- βColumn-level lineage for financial compliance audit trails
- βDomain-based governance for financial business domains
- βData observability with automated freshness and quality checks
- βStrong dbt, Airflow, and modern data stack integrations
Pros
- βReal-time metadata ingestion β always up-to-date data catalog
- βColumn-level lineage provides granular audit trail for financial compliance
- βOpen-source with no vendor lock-in and strong community support
Cons
- βRequires significant engineering resources for self-hosted deployment
- βLess mature business glossary and policy management than Collibra
- βUI and user experience less polished for non-technical finance users
Pricing
Prices are indicative and may vary.