Data Destination - KARTE Datahub
    • PDF

    Data Destination - KARTE Datahub

    • PDF

    Article summary

    summary

    Help page for ETL Configuration to KARTE Datahub.

    Data can be linked by ETL Configuration with TROCCO to a GCS bucket on Google Cloud Platform and Data Setting on the KARTE Datahub side.
    For settings on the KARTE Datahub side, please refer to External Service Connectivity (TROCCO).

    Setting items

    STEP1 Basic settings

    item nameindispensabledefault valueContents
    KARTE Datahub Connection ConfigurationYes-Please refer to KARTE Datahub's Connection Configuration.
    bucketYes-Specify the name of the Data Destination bucket.
    path prefixYes-Specify the Data Destination path prefix.
    TROCCO outputs multiple files in the Data Destination bucket, beginning with the path prefix.
    Note that upon transfer, files matching the path prefix are deleted and new files are uploaded.
    If you need to keep a file from the past, you can use Custom Variables to embed the transfer date and time in the path prefix,
    Separate path prefixes for each transfer.
    For example, by setting a Custom Variable with the path prefix trocco/$date$/data,
    If the transfer is made on January 1, 2020,
    trocco/20200101/data.000.00.csv
    You can separate paths by date, as in the following example.
    Output file formatYesCSVYou can choose the output file format.
    For more information, please click here.
    file compressionNo-If you wish to transfer compressed files, please select a compression format from the following.
    • gzip
    • bzip2
    • zip

    About the number of output files

    Due to TROCCO's specifications, multiple split files may be output to Data Destination.

    Example: path prefix is trocco/data

    Multiple files may be output as shown below.

    • trocco/data.000.00.csv
    • trocco/data.000.01.csv

    supplement

    Various links are listed below.


    Was this article helpful?