Data Source - Google Cloud Storage

Prev Next

summary

Help Page for ETL Configuration of Data Settings from Google Cloud Storage on Google Cloud Platform.

Setting items

STEP1 Basic settings

item name indispensable default name Contents
Google Cloud Storage Connection Configuration Yes - Select the preregistered Google Cloud Storage Connection Configuration that has the necessary permissions for this ETL Configuration.
bucket Yes - Select the Data Source bucket name.
path prefix Yes - Enter the Data Source path prefix.
TROCCO transfers multiple files starting with the path prefix of the Data Source bucket.
decompression format No - If the Data Source data is compressed, it can be decompressed and transferred.
The following decompression formats are supported Select according to the compression format of the data to be transferred.
If the data to be transferred is an uncompressed file, do not select the decompression format .
  • bzip2
  • gzip
  • tar.gz
  • zip

    • If you change the decompression format later, be sure to perform Automatic Data Setting.
    Relative path after decompression (regular expression) No - This can be entered when zip or tar.gz is selected as the decompression format.
    If you include a path separator, escape it using a backslash ( ⌘).
    Input file format Yes CSV/TSV Select the input file format.
    For more information, see About input file format settings.
    Transfer Method Yes Full Data Transfer Select either Full Data Transfer or Incremental Data Transfer.
    For more information on Incremental Data Transfer, see Incremental Data Transfer Function.

    STEP1 detailed settings

    Click on Set Details to display the configuration items.

    item name indispensable default value Contents
    Whether to continue the transfer if the file does not exist in the specified path. Yes Continue transfer Select whether or not you want the transfer to continue if the file is not found in the path specified in the Basic ETL Configuration.
    Depending on the selection of this item, the job status after the job is completed will also differ.
    • Continue transfer
      • The ETL Job continues.
      • Unless the ETL Job fails due to other factors, the Job status will be Succeeded after the ETL Job is completed.
    • Abort transfer and make an error
      • The ETL Job is aborted.
      • After the ETL Job is completed, the Job Status will be Error.

    Required Authority

    The following permissions are required to use this service.

    • storage.buckets.get
    • storage.buckets.list
    • storage.objects.get
    • storage.objects.list