Data Source - Google Cloud Storage
- Print
- PDF
Data Source - Google Cloud Storage
- Print
- PDF
Article summary
Did you find this summary helpful?
Thank you for your feedback
summary
Help Page for ETL Configuration of Data Settings from Google Cloud Storage on Google Cloud Platform.
constraints
Setting items
STEP1 Basic settings
item name | indispensable | default name | Contents |
---|---|---|---|
Google Cloud Storage Connection Configuration | Yes | - | Select the preregistered Google Cloud Storage Connection Configuration that has the necessary permissions for this ETL Configuration. |
bucket | Yes | - | Select the Data Source bucket name. |
path prefix | Yes | - | Enter the Data Source path prefix. TROCCO transfers multiple files starting with the path prefix of the Data Source bucket. |
decompression format | No | - | If the Data Source data is compressed, it can be decompressed and transferred. The following decompression formats are supported Select according to the compression format of the data to be transferred. If the data to be transferred is an uncompressed file, do not select the decompression format . bzip2 gzip tar.gz zip If you change the decompression format later, be sure to perform Automatic Data Setting. |
Relative path after decompression (regular expression) | No | - | This can be entered when zip or tar.gz is selected as the decompression format.If you include a path separator, escape it using a backslash ( ⌘). |
Input file format | Yes | CSV/TSV | Select the input file format. For more information, see About input file format settings. |
Transfer Method | Yes | Full Data Transfer | Select either Full Data Transfer or Incremental Data Transfer. For more information on Incremental Data Transfer, see Incremental Data Transfer Function. |
STEP1 detailed settings
Click on Set Details to display the configuration items.
item name | indispensable | default value | Contents |
---|---|---|---|
Whether to continue the transfer if the file does not exist in the specified path. | Yes | Continue transfer | Select whether or not you want the transfer to continue if the file is not found in the path specified in the Basic ETL Configuration. Depending on the selection of this item, the job status after the job is completed will also differ.
|
Required Authority
The following permissions are required to use this service.
- storage.buckets.get
- storage.buckets.list
- storage.objects.get
- storage.objects.list
Was this article helpful?