summary
Help Page for ETL Configuration of Data Settings for Amazon Web Services' S3.
About Amazon S3 and TROCCO use cases
TROCCO's product website provides examples of customer installations.
Please refer to this page together with this help page.
constraints
- none in particular
Setting items
STEP1 Basic settings
| item name | indispensable | default value | Contents |
|---|---|---|---|
| S3 Connection Configuration | Yes | - | Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration. Please refer to another page for Connection Configuration. |
| region | Yes | ap-northeast-1 | Enter the region you specified when creating the bucket to be used. For an explanation of regions, please refer to the official AWS page. |
| bucket | Yes | - | Specify the name of the Data Destination bucket. |
| path prefix | Yes | - | Specify the Data Destination path prefix. TROCCO outputs multiple files in the Data Destination bucket, beginning with the path prefix. |
| Output file extension | Yes | .csv | You will be asked to specify the extension of the output file. You can specify any extension you wish, but it is common to specify .csv, etc. to match the file format. |
| ACL | Yes | - | Access control lists (ACLs) manage permissions to access buckets and objects. You may choose any of the ACLs specified in Amazon S3. For more information on each ACL, click here. |
| Output file format | Yes | CSV | You can choose the output file format. For more information, please click here. |
| file compression | Yes | uncompressed | If you wish to transfer compressed files, please select a compression format from the following.
|
| transfer mode | Yes | parallel transfer | Select either Parallel Transfer or Output File Count Control as the transfer mode. When output file count suppression transfer is selected, file generation is performed internally with less parallel processing. If Data Source is a single file, Data Destination will be generated with a single file. |
STEP2 Detailed settings
| item name | default value | Contents |
|---|---|---|
| Naming Conventions for Multiple File Output | .%03d.%02d | You can set the rules for naming files when outputting multiple files. |