Data Source - Google Cloud Storage
    • PDF

    Data Source - Google Cloud Storage

    • PDF

    Article summary

    summary

    Help Page for ETL Configuration of Data Settings from Google Cloud Storage on Google Cloud Platform.

    constraints

    Setting items

    STEP1 Basic settings

    item nameindispensabledefault nameContents
    Google Cloud Storage Connection ConfigurationYes-Select the preregistered Google Cloud Storage Connection Configuration that has the necessary permissions for this ETL Configuration.
    bucketYes-Select the Data Source bucket name.
    path prefixYes-Enter the Data Source path prefix.
    TROCCO transfers multiple files starting with the path prefix of the Data Source bucket.
    decompression formatNo-If the Data Source data is compressed, it can be decompressed and transferred.
    The following decompression formats are supported Select according to the compression format of the data to be transferred.
    If the data to be transferred is an uncompressed file, do not select the decompression format .
  • bzip2
  • gzip
  • tar.gz
  • zip

  • If you change the decompression format later, be sure to perform Automatic Data Setting.
    Relative path after decompression (regular expression)No-This can be entered when zip or tar.gz is selected as the decompression format.
    If you include a path separator, escape it using a backslash ( ⌘).
    Input file formatYesCSV/TSVSelect the input file format.
    For more information, see About input file format settings.
    Transfer MethodYesFull Data TransferSelect either Full Data Transfer or Incremental Data Transfer.
    For more information on Incremental Data Transfer, see Incremental Data Transfer Function.

    STEP1 detailed settings

    Click on Set Details to display the configuration items.

    item nameindispensabledefault valueContents
    Whether to continue the transfer if the file does not exist in the specified path.YesContinue transferSelect whether or not you want the transfer to continue if the file is not found in the path specified in the Basic ETL Configuration.
    Depending on the selection of this item, the job status after the job is completed will also differ.
    • Continue transfer
      • The ETL Job continues.
      • Unless the ETL Job fails due to other factors, the Job status will be Succeeded after the ETL Job is completed.
    • Abort transfer and make an error
      • The ETL Job is aborted.
      • After the ETL Job is completed, the Job Status will be Error.

    Required Authority

    The following permissions are required to use this service.

    • storage.buckets.get
    • storage.buckets.list
    • storage.objects.get
    • storage.objects.list

    Was this article helpful?