Data Destination - Google Cloud Storage
    • PDF

    Data Destination - Google Cloud Storage

    • PDF

    Article summary

    summary

    Help page for ETL Configuration of Data Settings to Google Cloud Storage on Google Cloud Platform.

    constraints

    • none in particular

    Setting items

    STEP1 Basic settings

    item nameindispensabledefault valueContents
    Google Cloud Storage Connection ConfigurationYes-Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.
    Please refer to another page for Connection Configuration.
    bucketYes-Specify the name of the Data Destination bucket.
    path prefixYes-Specify the Data Destination path prefix.
    TROCCO outputs multiple files in the Data Destination bucket, beginning with the path prefix.
    Output file extensionYes.csvYou will be asked to specify the extension of the output file.
    You can specify any file extension, but it is common to specify .csv, etc. to match the file format.
    Output file formatYesCSVYou can select the format of the output file.
    For more information, please click here.
    file compressionNouncompressedIf you wish to transfer compressed files, please select a compression format from the following.
    • gzip
    • bzip2
    • zip
    transfer modeYesparallel transferSelect either Parallel Transfer or Output File Count Control as the transfer mode.
    When output file count suppression transfer is selected, file generation is performed internally with less parallel processing.
    If Data Source is a single file, Data Destination will be generated with a single file.
    *Output to a single file is limited to 1 GB due to GCS limitations. If the data exceeds 1 GB, the job will fail with an error.

    STEP1 Detailed settings

    Click on Advanced Settings to display the configuration items.

    item namedefault valueContents
    Naming Conventions for Multiple File Output.%03d.%02dYou can set the rules for naming files when outputting multiple files.

    Required Authority

    The following permissions are required to use this service.

    • storage.buckets.create
    • storage.buckets.get
    • storage.buckets.list
    • storage.objects.create
    • storage.objects.delete
    • storage.objects.get
    • storage.objects.list

    Was this article helpful?