It seemed so simple. A little schema issue in a database was trashing a feature in the app, increasing latency and degrading the user experience. The resident information engineer appears a repair to change the schema, and whatever seems great– in the meantime. Unbeknownst to them, that small repair totally clobbered all the dashboards […] A years plus into that whole “data is the brand-new oil” claptrap, and we’re still handling data piecemeal and without proper systems and controls. Information lakes have actually become information oceans and information warehouses have actually ended up being … well, whatever the huge variation of a warehouse is called (a waremansion I think). The essential performance here is that Datafold aggregates modifications in datasets– even datasets with billions of entries– into summaries so that information engineers can comprehend even subtle defects. It sits in the essential middle layer of the information stack– it’s not the data lake or information warehouse for keeping information, and it isn’t the end user BI tools like a Looker, Tableau or numerous others. Its ultimate dream is a world where data engineers never again have to get an over night page to fix a data quality issue….