Automatic metadata acquisition function
    • PDF

    Automatic metadata acquisition function

    • PDF

    Article summary

    summary

    Tables that are transferred and loaded into the data store using TROCCO's transfer and data mart jobs are automatically assigned metadata (or equivalent information).
    This page describes the types of metadata that are automatically acquired and the conditions under which they are acquired.

    Subject of automatic acquisition

    The following three types of information are obtained

    Metadata about the data source

    Connector for which metadata about the data source is to be retrieved

    Tables transferred using TROCCO's following Data Source Connectors are automatically populated with metadata about the data source.

    • Data Source - kintone
    • Data Source - MySQL
    • Data Source - PostgreSQL
    • Data Source - Salesforce
    • Data Source - Yahoo! Search Ads
    MySQL and PostgreSQL metadata

    The number of rows and size of the table are displayed as approximate values. Actual values are different.

    Specification for obtaining metadata about the data source

    Metadata about the Data Source is obtained by connecting to the Data Source using the ETL Configuration and Connection Configuration on TROCCO available to the Data Catalog administrator.
    Therefore, if ETL Configuration/Connection Configuration information is not available to the Data Catalog administrator, metadata about the data source may not be retrieved.

    column reference

    Connectors subject to automatic Column Setting

    Column References are automatically defined for groups of tables transferred using the following Data Source Connectors in TROCCO.

    • Data Source - MySQL
    • Data Source - PostgreSQL
    • Data Source - Salesforce

    Specification of Automatic Column Setting

    The SQL statements listed in the ETL Configuration on TROCCO available to the Data Catalog administrator are parsed to define as many possible table correspondences (column references) that can be JOINed.
    Please note that if the SQL statement in the ETL Configuration is so complex that it is difficult to parse, it may not be eligible to obtain column references.

    column lineage

    Tables loaded using the data transfer mode of TROCCO's DataMart feature will allow column linage to be viewed.

    Automatic takeover of metadata associated with columns

    For tables loaded using the Data Source mode of TROCCO's Data Mart function, metadata about the Data Source of the source column is automatically inherited for each column of the table in question.
    However, for the above metadata to be inherited, the column values must not have been modified in the Data Mart Configuration.

    supplementary information

    Resources on TROCCO available to Data Catalog managers

    Depends on your use of TROCCO's team features.

    • When using the Team function: Only ETL Configuration and Connection Configuration for which the Data Catalog administrator has the Operator role or higher will be used.
    • If you are not using the Team function: Only the ETL Configuration and Connection Configuration created bythe Data Catalog administrator will be used.

    Was this article helpful?