Amundsen Monthly Update — September 2021

Mark Grover
amundsen-io
Published in
2 min readOct 7, 2021

--

Summary

September highlights from the Amundsen community:

  • Integrating Slack with Amundsen at Convoy
  • Adding stats at a table level
  • Improved support for showing nested columns
  • Additional metadata for BigQuery
  • Search revamp
  • Extending badges browsing capabilities

All that and more details below!

Check out last month’s highlights here.

Don’t forget: Join our Slack community at slack.amundsen.io. We can’t wait to meet you!

Integrating Slack with Amundsen at Convoy

Image by Author: Slack Integration with Amundsen

This past summer, George Pu joined Convoy’s Data Platform team as an intern to help surface common questions about data usage within Slack through Amundsen. The result? A usable and robust Slack integration. Learn more about the process he took and the team’s next steps: Integrating Slack with Amundsen for Ease of Data Discovery

Adding stats at a table level

Up until now, we have allowed adding stats (min, max, count distinct) on a column level. Moving forward, we now additionally allow adding stats on a table level, allowing us to share stats like “daily active users” or “query count” on a table basis.

See PR details for more info! Huge props to Allison Suarez Miranda!

Improved support for showing nested columns

We now support showing nested columns as individual rows in the list of columns instead of showing them in a modal.

See PR details for more info. Thanks to Daniel Won!

Additional metadata for BigQuery

We now show the column’s mode for BigQuery tables.

See PR details for more info. Thanks to Marwan Baghdad!

Search revamp

We’re looking to revamp search with a cleaner backend implementation, more robust queries, better customizability, and make use of modern v7 ES features.

This revamp would include deprecating Apache Atlas as a search backend. If you run Amundsen without Elasticsearch and instead rely purely on Atlas for search AND migrating to Elasticsearch would be prohibitive, please reach out to Dmitriy Kunitskiy. The goal is to improve the Amundsen search/ranking experience and remove a limited and likely-unused option of using Atlas in place of ES.

Check out the RFC for more info and let us know what you think!

Extending badges browsing capabilities — badges on landing page and browse view

We’re looking to introduce a “Popular/All badges” section below “Popular tags” on the landing page, as well as a browse section.

Check out the RFC for more info and let us know what you think!

Announcements

📣 No community meeting updates from last month due to my vacation. I took a week off and went to Orcas Island for a short trip before Labor Day!

Coming up next…

Next community meeting

  • Date: Thursday, November 4, 9am Pacific, 12pm Eastern, 6pm Central Europe
  • Add to your calendar: https://evt.to/sahdiasw

Join us on Slack: slack.amundsen.io

Subscribe for periodic updates: Medium & Twitter

Curated with ❤ by Stemma

--

--