summary
Tables that are transferred and loaded into the data store using TROCCO's transfer and data mart jobs are automatically assigned metadata (or equivalent information).
This page describes the types of metadata that are automatically acquired and the conditions under which they are acquired.
Subject of automatic acquisition
The following three types of information are obtained
Metadata about the data source
Connector for which metadata about the data source is to be retrieved
Tables transferred using TROCCO's following Data Source Connectors are automatically populated with metadata about the data source.
- Data Source - kintone
- Data Source - MySQL
- Data Source - PostgreSQL
- Data Source - Salesforce
- Data Source - Yahoo! Search Ads
The number of rows and size of the table are displayed as approximate values. Actual values are different.
Specification for obtaining metadata about the data source
Metadata about the Data Source is obtained by connecting to the Data Source using the ETL Configuration and Connection Configuration on TROCCO available to the Data Catalog administrator.
Therefore, if ETL Configuration/Connection Configuration information is not available to the Data Catalog administrator, metadata about the data source may not be retrieved.
column reference
Connectors subject to automatic Column Setting
Column References are automatically defined for groups of tables transferred using the following Data Source Connectors in TROCCO.
- Data Source - MySQL
- Data Source - PostgreSQL
- Data Source - Salesforce
Specification of Automatic Column Setting
The SQL statements listed in the ETL Configuration on TROCCO available to the Data Catalog administrator are parsed to define as many possible table correspondences (column references) that can be JOINed.
Please note that if the SQL statement in the ETL Configuration is so complex that it is difficult to parse, it may not be eligible to obtain column references.
column lineage
Tables loaded using the data transfer mode of TROCCO's DataMart feature will allow column linage to be viewed.
Automatic takeover of metadata associated with columns
For tables loaded using the Data Source mode of TROCCO's Data Mart function, metadata about the Data Source of the source column is automatically inherited for each column of the table in question.
However, for the above metadata to be inherited, the column values must not have been modified in the Data Mart Configuration.
supplementary information
Resources on TROCCO available to Data Catalog managers
Depends on your use of TROCCO's team features.
- When using the Team function: Only ETL Configuration and Connection Configuration for which the Data Catalog administrator has the Operator role or higher will be used.
- If you are not using the Team function: Only the ETL Configuration and Connection Configuration created bythe Data Catalog administrator will be used.