Posted by: Brentembt
data lineage, data modeling, database architecture, meta data, visual data lineage
In speaking with customers lately, I am finding more and more attention spent on the lineage of data. It isn’t enough these days to manage these type of complex movements and manipulations of data with spreadsheets. More often than not, I am finding customers asking for the golden nugget feature of being able to reverse engineer the data lineage in a visual manner. This is a highly complicated request. It is not enough these days to just reverse engineer a database and call it documented. More and more, people need to understand and document the movement of data. I find it interesting we have a common way to exchange meta data via CWM, but would’nt be great to have a common meta model for exchange lineage and visualizing that in a simpe form. We, meaning, Embarcadero Technologies have been listening to our customers and are investing in these types of requirements. Our data modeling product ER/Studio today can not only reverse engineer the schema but enables users to document the data lineage visually. Documenting the lineage regardless of transformation syntax provides great optics in the flow of data by the data experts. Until the golden parser is evolved in a manner to reverse engineer visual data lineage, it is a great start to understand impact and garner more interaction as lineage develops. Stay tuned as we continue to innovate and evolve around this visual data lineage life cycle.