Migrations are one of the most common initiatives that data teams own. But as everyone knows, they are complex beasts. They always take longer than they need to, many different teams are involved, and they’re super visible — not just to users, but execs, too. Everyone is anxious when a…

Summary August highlights from the Amundsen community: Driving Data Governance Maturity with Amundsen at Revolut Amundsen at Devoted Health Using Column Level Lineage in Amundsen at Alvin Extending support for databuilder Atlas integration with table metadata models OpenLineage extractor for databuilder Generalized application model and adding Databricks application support Data quality…

“Who’s the data owner?” Learn how to define data ownership and how a data catalog can help you document this information. — In the first paragraph of a post I had written earlier this month, I referred to data engineers as producers of data. Someone immediately replied something to the extent of, “You lost me at the first sentence. Data Engineers can’t be data owners.” Clearly, I ruffled some feathers, and I…

Summary July highlights from the Amundsen community: ML features discovery in Amundsen MySQL support in Amundsen Compatibility with Elasticsearch 7 Salesforce & Oracle extractors Adding support for nested data types in Delta Proposal to make programmatic descriptions editable How-to: Setup OIDC Authentication in Amundsen All that and more details below! Check…

Here are the top two reasons why, despite all good intentions, many data catalogs end up failing — You notice that data producers (data engineers, product engineers, analytics engineers) and data consumers (data analysts, data scientists, business users) don’t know what data exists, how to use it, and what is trustworthy. You see a ton of questions on slack and a real hit on the productivity of the…

Summary June highlights from the Amundsen community: How Convoy got 80% of its tech org to use Amundsen Query Intelligence: View common query patterns in Amundsen Unifying shared dependencies — making life a lot easier for Amundsen devs and installers Amundsen now uses Mode discovery API Initial support to use MySQL…

Learnings from dozens of companies on how to make your data catalog successful — There are only 2 goals that matter when it comes to measuring the success of a data catalog: 1) adoption, and 2) customer satisfaction. If you nail these two, you are successful. I’m the co-creator of the leading open-source data catalog, Amundsen, which is used by 35+ companies including Instacart…

Why Snap chose Amundsen, dbt integration, lineage graph viz, mono repo, and more! Summary May highlights from the Amundsen community: Why Snap chose Amundsen dbt ♥ Amundsen Lineage graph viz One repo to rule them all ML feature discovery in Amundsen Answer how to best use this table — with queries…

Today, we are excited to announce the launch of Stemma — a fully managed data catalog, powered by Amundsen, the leading open-source data catalog with the largest community and broadest adoption. We raised $4.8M …