About output file format settings
- Print
- PDF
About output file format settings
- Print
- PDF
Article summary
Did you find this summary helpful?
Thank you for your feedback
summary
In the Data Destination File/Storage Connector, the output file format can be set in STEP 1 of ETL Configuration, and detailed settings for the output file can be configured in Output Option in STEP 2.
This page describes the output file formats and Connectors supported by TROCCO, as well as various Output Option setting items.
Output file format
CSV/TSV are supported.
Some Connectors also support JSON Lines.
Refer to the table below for information on Connectors and supported file formats.
| File/Storage Connector | CSV/TSV | JSON Lines |
|---|---|---|
| Data Destination - Amazon S3 | ✓ | ✓ |
| Data Destination - Azure Blob Storage | ✓ | ✓ |
| Data Destination - Box | ✓ | - |
| Data Destination - FTP/FTPS | ✓ | ✓ |
| Data Destination - Google Cloud Storage | ✓ | ✓ |
| Data Destination - Google Drive | ✓ | - |
| Data Destination - SFTP | ✓ | ✓ |
Output Option Setting Items
List of setting items in STEP 2 "Output Option" of ETL Configuration Edit.
Note that the setting items vary depending on the output file format.
CSV/TSV
Embulk's csv-formatter-plugin is used.
| item name | default value | Description. |
|---|---|---|
| delimiter | , | Select the delimiter character for the CSV data. |
| newline character | CRLF | Select the rule for line breaks from CR, CRLF, and LF. |
| Newline character in field | LF | Select the rule for line breaks in the field from CR, CRLF, and LF. |
| character encoding | UTF-8 | Sets the character encoding method. |
| How to grant quotes | MINIMAL | Quoting rules can be selected from the followingALL (quoting all fields)MINIMAL (quarto only if necessary, delimiters, etc. in the field)NONE (no quoting) |
| escape character | \ | Sets the escape character. |
| header | enable | If you select Enable, header lines are also transferred. If you do not need a header line, select Disable. |
| String to replace NULL | Not set | You can set a string to replace NULLs. If you select "Set", you can enter the string after the replacement. |
| Default time zone | UTC | Sets the time zone for time output. This setting is overridden by the time zone in the column settings. |
| Column Setting | %Y-%m-%d %H:%M:%S.%6N %z | For timestamp type column columns, you can specify the column name and set the date format and time zone. The default values shown at left are the default values for date formats. |
JSON Lines
embulk-formatter-jsonl.
For details on setting items, see Confirmation.
| item name | default value | Description. |
|---|---|---|
| character encoding | UTF-8 | Select a character encoding method from the followingUTF-8UTF-16LEUTF-32BEUTF-32LE |
| newline character | LF | Select a newline character rule from the followingCRLFLFCRNULNO |
| Date Format | - | You can set the date format. |
| time zone | - | Time zone can be set. If you use this option, you must also set the date format. |
Was this article helpful?