About output file format settings

Prev Next

summary

In the Data Destination File/Storage Connector, the output file format can be set in STEP 1 of ETL Configuration, and detailed settings for the output file can be configured in Output Option in STEP 2.
This page describes the output file formats and Connectors supported by TROCCO, as well as various Output Option setting items.

Output file format

CSV/TSV are supported.
Some Connectors also support JSON Lines.
Refer to the table below for information on Connectors and supported file formats.

File/Storage Connector CSV/TSV JSON Lines
Data Destination - Amazon S3 ✓ ✓
Data Destination - Azure Blob Storage ✓ ✓
Data Destination - Box ✓ -
Data Destination - FTP/FTPS ✓ ✓
Data Destination - Google Cloud Storage ✓ ✓
Data Destination - Google Drive ✓ -
Data Destination - SFTP ✓ ✓

Output Option Setting Items

List of setting items in STEP 2 "Output Option" of ETL Configuration Edit.
Note that the setting items vary depending on the output file format.

CSV/TSV

Embulk's csv-formatter-plugin is used.

item name default value Description.
delimiter , Select the delimiter character for the CSV data.
newline character CRLF Select the rule for line breaks from CR, CRLF, and LF.
Newline character in field LF Select the rule for line breaks in the field from CR, CRLF, and LF.
character encoding UTF-8 Sets the character encoding method.
How to grant quotes MINIMAL Quoting rules can be selected from the following
  • ALL (quoting all fields)
  • MINIMAL (quarto only if necessary, delimiters, etc. in the field)
  • NONE (no quoting)
    		•
    escape character \ Sets the escape character.
    header enable If you select Enable, header lines are also transferred.
    If you do not need a header line, select Disable.
    String to replace NULL Not set You can set a string to replace NULLs.
    If you select "Set", you can enter the string after the replacement.
    Default time zone UTC Sets the time zone for time output.
    This setting is overridden by the time zone in the column settings.
    Column Setting %Y-%m-%d %H:%M:%S.%6N %z For timestamp type column columns, you can specify the column name and set the date format and time zone.
    The default values shown at left are the default values for date formats.

    JSON Lines

    embulk-formatter-jsonl.
    For details on setting items, see Confirmation.

    item name default value Description.
    character encoding UTF-8 Select a character encoding method from the following
  • UTF-8
  • UTF-16LE
  • UTF-32BE
  • UTF-32LE
    		•
    newline character LF Select a newline character rule from the following
  • CRLF
  • LF
  • CR
  • NUL
  • NO
    		•
    Date Format - You can set the date format.
    time zone - Time zone can be set.
    If you use this option, you must also set the date format.