Data Destination - Amazon S3
    • PDF

    Data Destination - Amazon S3

    • PDF

    Article summary

    summary

    Help Page for ETL Configuration of Data Settings for Amazon Web Services' S3.

    About Amazon S3 and TROCCO use cases

    TROCCO's product website provides examples of customer installations.
    Please refer to this page together with this help page.

    constraints

    • none in particular

    Setting items

    STEP1 Basic settings

    item nameindispensabledefault valueContents
    S3 Connection ConfigurationYes-Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.
    Please refer to another page for Connection Configuration.
    regionYesap-northeast-1Enter the region you specified when creating the bucket to be used. For an explanation of regions, please refer to the official AWS page.
    bucketYes-Specify the name of the Data Destination bucket.
    path prefixYes-Specify the Data Destination path prefix.
    TROCCO outputs multiple files in the Data Destination bucket, beginning with the path prefix.
    Output file extensionYes.csvYou will be asked to specify the extension of the output file. You can specify any extension you wish, but it is common to specify .csv, etc. to match the file format.
    ACLYes-Access control lists (ACLs) manage permissions to access buckets and objects.
    You may choose any of the ACLs specified in Amazon S3.
    For more information on each ACL, click here.
    Output file formatYesCSVYou can choose the output file format. For more information, please click here.
    file compressionYesuncompressedIf you wish to transfer compressed files, please select a compression format from the following.
    • gzip
    • bzip2
    • zip
    transfer modeYesparallel transferSelect either Parallel Transfer or Output File Count Control as the transfer mode.
    When output file count suppression transfer is selected, file generation is performed internally with less parallel processing.
    If Data Source is a single file, Data Destination will be generated with a single file.

    STEP2 Detailed settings

    item namedefault valueContents
    Naming Conventions for Multiple File Output.%03d.%02dYou can set the rules for naming files when outputting multiple files.

    Was this article helpful?