Data Mesh — AI/ML Model Output Data Products
The concept of the data mesh revolves around the fact that data is perceived as a product and is shared in a standardised manner throughout an organisation in a mesh structure. This allows organisations to achieve easily and in a standardised manner interactions between systems and benefit from the power of data on a true enterprise scale.
Data Products versus new Data Products
When talking about data and data products a large number of companies start debating what is data, what is a data product and can you create a new data product from derived data.
One of the guiding principles in the concept of a Data Mesh is that data should not be duplicated. Meaning, in the ideal setup of a Data Mesh you should refer to Data in the original location and step away from consolidating it and keeping multiple copies of it.
When creating new data products from derived data we do not break this guiding principle, the new data product can be considered a fully new data set even though it is based upon data derived from other domains.
As an example, when you need to predict “something” it will require information which you can acquire form data nodes in the wide Data Mesh. While the prediction is based upon existing data the prediction itself will be new…
