Data Destination - Treasure Data
- 07 Dec 2022
- Print
- DarkLight
- PDF
Data Destination - Treasure Data
- Updated on 07 Dec 2022
- Print
- DarkLight
- PDF
Article Summary
Share feedback
Thanks for sharing your feedback!
This is a machine-translated version of the original Japanese article.
Please understand that some of the information contained on this page may be inaccurate.
summary
This page is a help page for setting up data transfer to Treasure Data.
Supported Protocols
- Data Transfer (Embulk)
Using embulk-output-td
constraint
- Nothing in particular
Setting items
STEP1 Basic settings
| Item | namerequireddefault | valuecontent | |
|---|---|---|---|
| Treasure Data Connection Information | Yes | - | From the connection information registered in advance, select the one that has the necessary permissions for this transfer setting. |
| Database name | Yes | - | Enter the name of the database to which you want to transfer data. |
| table | Yes | - | Enter the name of the table to which you want to transfer data. |
| Time Column | No | - | Specifies the time column name to use for the index. |
| Automatic Tablei Generation | Yes | Create a table if it doesn't exist | If the table specified in "Table" does not exist, select whether to create it automatically. |
| Transfer Mode | Yes | append | Select the transfer mode. For details on each mode, see About Transfer Modes below. |
STEP2 Advanced settings
| Item name | default value |
|---|---|
| File split size | 16384 |
| Whether to abort the transfer if an incorrect record exists | NO |
| Default time zone | UTC |
| Maximum number of retries | 20 |
| Initial number of retries (ms) | 1000 |
| Maximum retry interval (ms) | 90000 |
About Transfer Modes
| Mode | Details |
|---|---|
| append | Make an append to the table. Populate the specified existing table directly. |
| replace | Wash the table. First, create a temporary table and upload the data. When the upload is complete, the temporary table replaces the table specified in the table. The schema of an existing table is not migrated to the replaced table. |
| truncate | Make an append to the table. First, create a temporary table and upload the data. When the upload is complete, the temporary table replaces the table specified in the table. It also appends the schema of the existing table to the replaced table. |
Was this article helpful?