About output file format settings
- 17 Jul 2024
- Print
- PDF
About output file format settings
- Updated on 17 Jul 2024
- Print
- PDF
Article summary
Did you find this summary helpful?
Thank you for your feedback
summary
In the destination file/storage connector, the output file format can be set in STEP 1 of the transfer settings, and detailed settings for the output file can be configured in STEP 2 Output Options.
This page describes the output file formats and connectors supported by TROCCO, as well as various output option setting items.
Output file format
CSV/TSV are supported.
Some connectors also support JSON Lines.
Refer to the table below for connectors and supported file formats.
| File and storage system connectors | CSV/TSV | JSON Lines |
|---|---|---|
| Destination - Amazon S3 | ✓ | ✓ |
| Destination - Azure Blob Storage | ✓ | ✓ |
| Destination - Box | ✓ | - |
| Destination - FTP/FTPS | ✓ | ✓ |
| Destination - Google Cloud Storage | ✓ | ✓ |
| Destination - Google Drive | ✓ | - |
| Destination - SFTP | ✓ | ✓ |
Output Option Setting Items
List of setting items for STEP 2 "Output Options" of Transfer Settings Edit.
Note that the setting items vary depending on the output file format.
CSV/TSV
Embulk's csv-formatter-plugin is used.
| item name | default value | Description. |
|---|---|---|
| delimiter | , | Select the delimiter character for the CSV data. |
| newline character | CRLF | Select the rule for line breaks from CR, CRLF, and LF. |
| Newline character in field | LF | Select the rule for line breaks in the field from CR, CRLF, and LF. |
| character encoding | UTF-8 | Sets the character encoding method. |
| How to grant quotes | MINIMAL | Quoting rules can be selected from the followingALL (quoting all fields)MINIMAL (quarto only if necessary, delimiters, etc. in the field)NONE (no quoting) |
| escape character | \blow | Sets the escape character. |
| header | enable | If you select Enable, header lines are also transferred. If you do not need a header line, select Disable. |
| String to replace NULL | Not set | You can set a string to replace NULLs. If you select " Set", you can enter the string after the substitution. |
| Default time zone | UTC | Sets the time zone for time output. This setting is overridden by the time zone in the column settings. |
| Column Setting | %Y-%m-%d %H:%M:%S.%6N %z | For timestamp type column columns, you can specify the column name and set the date format and time zone. The default values shown at left are the default values for date formats. |
JSON Lines
embulk-formatter-jsonl.
See Confirmation for details on setting items.
| item name | default value | Description. |
|---|---|---|
| character encoding | UTF-8 | Select a character encoding method from the followingUTF-8UTF-16LEUTF-32BEUTF-32LE |
| newline character | LF | Select a newline character rule from the followingCRLFLFCRNULNO |
| Date Format | - | You can set the date format. |
| time zone | - | Time zone can be set. If you use this option, you must also set the date format. |
Was this article helpful?