Data Catalog Setting

TROCCO
- TROCCO
- COMETA
English

Data Catalog Setting

Article summary

Did you find this summary helpful?

Thank you for your feedback!

summary

Click on Data Catalog Setting in the upper right corner of the screen.
Data Catalog Settings allow you to configure various settings related to the Data Catalog.

TROCCO Basic Metadata Settings
Templates for user-defined metadata
Metadata Import
Data Store Coordination Management

TROCCO Basic Metadata Settings

Set the fields to be displayed in the column information.
The default settings are as follows

Logical name: Display
Explanation: Not shown

Templates for user-defined metadata

Set the fields to be populated with user-defined metadata for each table column.

Notes on templates for user-defined metadata

Only one template for user-defined metadata can be created per table column.
Fields added to the template cannot be deleted later.
Fields that are set to be****required cannot be made mandatory later.

item name	indispensable	remarks
Template Name	✓	Enter a template name.
Template Type	✓	Select either from a table or a column.
Field Name	✓	Enter a field name.
Tip.	-	You can enter a hint for the field. The information entered in this field will be displayed on the user-defined metadata entry screen.
data type	✓	Select one of the following `String` `Text(Markdown)` `Integer` `Boolean` A string entered as a``String or `Text (Markdown) type` is the target string in a table column search.
require entry	-	If this item is enabled, when editing user-defined metadata, the value of the corresponding field must be entered before it can be saved. This item cannot be changed later.

Metadata Import

CSV files can be used to import basic metadata values.
The results of the import can also be viewed from the import history at the bottom of the screen.

Metadata Import Restrictions

Subject of metadata import

Metadata import using CSV files is supported only for basic metadata.
Import of other metadata is not supported.

Character encoding of CSV file

UTF-8 is recommended.
For character codes other than UTF-8, some characters may not be readable.

File size limit for CSV upload

The maximum file size for CSV files that can be uploaded is 100 MB.

if metadata has already been entered

If metadata values have already been entered, the imported values will overwrite the existing values.

CSV file format

Click on Download CSV Template.
Edit the downloaded CSV file accordingly and perform upload and import.

A CSV with the field name entered in the first line will be downloaded.
Enter metadata as appropriate on the second and subsequent lines.

Note that the structure of the CSV file will vary depending on your data store and the tables or columns to be imported.
Below is a description of the CSV file structure for each data store.

If you are using a BigQuery data store

For the first line of the CSV file, enter the following

Basic Table Metadata
- project_id,dataset_id,table_id,logical_name,description
column basic metadata
- project_id,dataset_id,table_id,column_id,logical_name,description

Enter the second and subsequent lines of the CSV file based on the table below.

column name	indispensable	Information to be entered
`project_id`	✓	Project Name
`dataset_id`	✓	Data Set Name
`table_id`	✓	table name
`column_id`	✓*	Column name associated with table Required only when importing basic column metadata
`logical_name`	-	Value you want to enter in the Logical Name field
`description`	-	Value you want to enter in the Description field

If you are using Snowflake's data store

For the first line of the CSV file, enter the following

Basic Table Metadata
- database_name,schema_name,table_name,logical_name,description
column basic metadata
- database_name,schema_name,table_name,column_name,logical_name,description

Enter the second and subsequent lines of the CSV file based on the table below.

column name	indispensable	Information to be entered
`database_name`	✓	Database Name
`schema_name`	✓	schema name
`table_name`	✓	table name
`column_name`	✓*	Column name associated with table Required only when importing basic column metadata
`logical_name`	-	Value you want to enter in the Logical Name field
`description`	-	Value you want to enter in the Description field