summary
Help page for ETL Configuration of Data Settings to Google Cloud Storage on Google Cloud Platform.
constraints
- none in particular
Setting items
STEP1 Basic settings
| item name | indispensable | default value | Contents |
|---|---|---|---|
| Google Cloud Storage Connection Configuration | Yes | - | Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration. Please refer to another page for Connection Configuration. |
| bucket | Yes | - | Specify the name of the Data Destination bucket. |
| path prefix | Yes | - | Specify the Data Destination path prefix. TROCCO outputs multiple files in the Data Destination bucket, beginning with the path prefix. |
| Output file extension | Yes | .csv | You will be asked to specify the extension of the output file. You can specify any file extension, but it is common to specify .csv, etc. to match the file format. |
| Output file format | Yes | CSV | You can select the format of the output file. For more information, please click here. |
| file compression | No | uncompressed | If you wish to transfer compressed files, please select a compression format from the following.
|
| transfer mode | Yes | parallel transfer | Select either Parallel Transfer or Output File Count Control as the transfer mode. When output file count suppression transfer is selected, file generation is performed internally with less parallel processing. If Data Source is a single file, Data Destination will be generated with a single file. *Output to a single file is limited to 1 GB due to GCS limitations. If the data exceeds 1 GB, the job will fail with an error. |
STEP1 Detailed settings
Click on Advanced Settings to display the configuration items.
| item name | default value | Contents |
|---|---|---|
| Naming Conventions for Multiple File Output | .%03d.%02d |
You can set the rules for naming files when outputting multiple files. |
Required Authority
The following permissions are required to use this service.
- storage.buckets.create
- storage.buckets.get
- storage.buckets.list
- storage.objects.create
- storage.objects.delete
- storage.objects.get
- storage.objects.list