About Data Catalog

Help page about data catalogs.

What is Data Catalog?

Issues such as "I don't know where the data is" and "I wonder when, where, and for what purpose this data was created" become more and more apparent as the data handled increases, and eventually become bottlenecks in data analysis operations.

The solution to these challenges is the** Data Catalog** is the data catalog.
Data catalogs help solve the data management challenges listed above by managing metadata, which is "data about data.

Features of the TROCCO Data Catalog

TROCCO's data catalog automatically retrieves metadata from the data present in your data analysis infrastructure and generates a data catalog.
The system also provides various functions to promote data utilization, such as data retrieval based on metadata, automatic generation of ER diagrams and****lineage based on acquired metadata, and a query editor that allows users to test queries on the spot.

Supported Data Stores

TROCCO's data catalog supports the following data stores
Automatically catalog tables/columns accumulated in the following data stores

• Google BigQuery
• Snowflake

Various Functions

For more information on each of the features of TROCCO's data catalog, please refer to the respective linked articles.

Automatic acquisition and update

• Automatic updating of assets ( automatic asset capturing function )
• Automatic acquisition of metadata ( automatic metadata acquisition function )

Data Selection

• Finding data ( table/column search )
• See the relationship between the data ( ER diagram )
• Define data relationships ( column references )

Data Understanding

• Understanding Data ( Table Information )
• Tracing the ancestry of data ( lineage)

Data tabulation and data checking

• JOIN Analysis (JOIN Analysis )
• Write a query ( Query Editor)

Importing and Exporting Metadata

• Importing metadata ( metadata import )
• Transfer metadata ( source - TROCCO)

supplementary information

• Data Catalog Glossary ( Data Catalog Glossary )