Below you will find pages that utilize the taxonomy term “data”
Writing
Airbnb's Metric Store: Minerva
Data lineage is a problem because most companies have several tables and queries before humans consume it!
This has well known challenges: changes do not propagate downstream from the source, and reliable (fresh, updated or complete) data is not always available.
What does Minerva do? I was expecting Minerva to a database (collection of tables), but it turns out that Minerva is what I’ll call: Data Transformation Manager.
It overlaps quite a bit with dbt but it’s not a pure execution layer.