Metadata describes the properties of data. It includes attributes, such as the names, locations, structures, schema, ownership, lineage, and usage of the data.
Added Perspectives
Metadata is the data that is needed to manage data. Just as data about finance is needed to manage financial assets, data about data is needed to manage data assets. Metadata is used to classify and describe data, and to guide and control the use of data. Data management is complex and metadata is essential. But metadata itself can be challenging and needs to be managed. Metadata exists in many forms—as data glossaries, data catalogs, data models, data profiles, semantic layers, taxonomies, ontologies, and much more. Data governance has a role in managing metadata quality, completeness, and consistency.
- Dave Wells in Data Governance Automation: Making the Most of Data and Analytics Technologies
April 30, 2020 (Report)
Metadata is an essential output of data pipelines. In addition to producing data for delivery to a destination, pipelines must also produce the metadata that describes data provenance, lineage, and quality. These types of metadata are fundamental for delivery of trusted data. The scope and types of metadata expands when pipeline automation is metadata driven. Execution schedules, for example, become essential metadata for orchestration. Similarly, schema metadata becomes critical when AI/ML is used to detect and adapt to schema changes.
- Dave Wells in Architecting and Automating Data Pipelines: A Guide to Efficient Data Engineering for BI and Data Science
October 16, 2020 (Report)
It seems that everyone wants data management but few care about metadata. Just as you need data about finances for effective financial management, you need data about data (metadata) for effective data management. You can’t manage data without metadata. The data catalog has become the new gold standard for metadata and a cornerstone of data curation. The data catalog has become the new gold standard for metadata. Metadata is the core of a data catalog. Every catalog collects data about the data inventory and also about processes, people, and platforms related to data. Metadata tools of the past collected business, process, and technical metadata, and data catalogs continue that practice.
- Dave Wells in The Ultimate Guide to Data Catalogs: Key Things to Consider When Selecting a Data Catalog
April 30, 2018 (Report)
Relevant Content
Jan 28, 2020 - The difficulties of data management have intensified at a steady pace over the past several years.
Dec 30, 2019 - Self-driving data has become a reality. Just like autonomous vehicles automate driving, self-driving data automates data using DataOps techniques.
Related Terms
Unleash The Power Of Your Data
Providing modern, comprehensive data solutions so you can turn data into your most powerful asset and stay ahead of the competition.
Learn how we can help your organization create actionable data strategies and highly tailored solutions.
© Datalere, LLC. All rights reserved