Data Catalog Setting
    • PDF

    Data Catalog Setting

    • PDF

    Article summary

    summary

    Click on Data Catalog Setting in the upper right corner of the screen.
    Data Catalog Settings allow you to configure various settings related to the Data Catalog.

    image

    TROCCO Basic Metadata Settings

    Set the fields to be displayed in the column information.
    The default settings are as follows

    • Logical name: Display
    • Explanation: Not shown

    Templates for user-defined metadata

    Set the fields to be populated with user-defined metadata for each table column.

    Notes on templates for user-defined metadata
    • Only one template for user-defined metadata can be created per table column.
    • Fields added to the template cannot be deleted later.
    • Fields that are set to be****required cannot be made mandatory later.
    item nameindispensableremarks
    Template NameEnter a template name.
    Template TypeSelect either from a table or a column.
    Field NameEnter a field name.
    Tip.-You can enter a hint for the field.
    The information entered in this field will be displayed on the user-defined metadata entry screen.
    data typeSelect one of the following
  • String
  • Text(Markdown)
  • Integer
  • Boolean
  • A string entered as a``String or Text (Markdown) type is the target string in a table column search.
    require entry-If this item is enabled, when editing user-defined metadata, the value of the corresponding field must be entered before it can be saved.
    This item cannot be changed later.

    Metadata Import

    CSV files can be used to import basic metadata values.
    The results of the import can also be viewed from the import history at the bottom of the screen.

    image

    Metadata Import Restrictions

    Subject of metadata import

    Metadata import using CSV files is supported only for basic metadata.
    Import of other metadata is not supported.

    Character encoding of CSV file

    UTF-8 is recommended.
    For character codes other than UTF-8, some characters may not be readable.

    File size limit for CSV upload

    The maximum file size for CSV files that can be uploaded is 100 MB.

    if metadata has already been entered

    If metadata values have already been entered, the imported values will overwrite the existing values.

    CSV file format

    Click on Download CSV Template.
    Edit the downloaded CSV file accordingly and perform upload and import.

    A CSV with the field name entered in the first line will be downloaded.
    Enter metadata as appropriate on the second and subsequent lines.

    Note that the structure of the CSV file will vary depending on your data store and the tables or columns to be imported.
    Below is a description of the CSV file structure for each data store.

    If you are using a BigQuery data store

    For the first line of the CSV file, enter the following

    • Basic Table Metadata
      • project_id,dataset_id,table_id,logical_name,description
    • column basic metadata
      • project_id,dataset_id,table_id,column_id,logical_name,description

    Enter the second and subsequent lines of the CSV file based on the table below.

    column nameindispensableInformation to be entered
    project_idProject Name
    dataset_idData Set Name
    table_idtable name
    column_id✓*Column name associated with table
    Required only when importing basic column metadata
    logical_name-Value you want to enter in the Logical Name field
    description-Value you want to enter in the Description field

    If you are using Snowflake's data store

    For the first line of the CSV file, enter the following

    • Basic Table Metadata
      • database_name,schema_name,table_name,logical_name,description
    • column basic metadata
      • database_name,schema_name,table_name,column_name,logical_name,description

    Enter the second and subsequent lines of the CSV file based on the table below.

    column nameindispensableInformation to be entered
    database_nameDatabase Name
    schema_nameschema name
    table_nametable name
    column_name✓*Column name associated with table
    Required only when importing basic column metadata
    logical_name-Value you want to enter in the Logical Name field
    description-Value you want to enter in the Description field
    Example of CSV file input

    The following is an example CSV file used for importing basic table metadata from a BigQuery data store.

    image

    If import fails

    Click View Error Log in****Import History to see the cause of the error.

    data-catalog-settings-v1-2024-08-29-18-3-3

    Data Store Coordination Management

    See Data Store Coordination Management.


    Was this article helpful?