Contents x
    Data Source - Google Drive
    • 27 Dec 2022
    • Print
    • Dark
      Light
    • PDF
    Contents

    Data Source - Google Drive

    • Updated on 27 Dec 2022
    • Print
    • Dark
      Light
    • PDF
    Article Summary

    Note

    This is a machine-translated version of the original Japanese article.
    Please understand that some of the information contained on this page may be inaccurate.

    Overview

    • This is the help page for setting up data transfer from Google Drive.
    • You can transfer various files in a folder.

    Supported Protocols

    • Data Transfer (Embulk)

    Target File Format

    • CSV/TSV
    • JSON Lines
    • JSONPath
    • LTSV
    • Microsoft Excel (xlsx or xls file)

    Settings

    STEP 1: General Settings

    Field NameRequiredCustom VariablesDescription
    Google Drive connection informationYesbadSelect Google Drive Connection Information.
    With Google Drive connection information, you can perform OAuth authentication or authentication using a service account (JSON key).
    Folder IDYesbadSpecifies the ID of the folder. Files directly under the folder specified here are transferred. Files in subfolders are not transferred.

    How to get the folder ID:
    If the URL of a folder in Google Drive is, 0B68XXXXXX is the folder ID.
    https://drive.google.com/drive/u/0/folders/0B68XXXXXX
    Regular expressions for file namesNoAvailableYou can specify the files to be transferred with regular expressions.
    Example: ^report_ (Transferring a file with report_ a file name beginning with )
    Input file formatYesCSV/TSVSpecify the format of the input file.
    For details, refer to About setting the input file format.

    Limitations

    • Files that exist in the top level (no folders) cannot be transferred. Be sure to place the files you want to transfer under the folder.
    • It does not support the differential transfer function that transfers except for transferred files.
    Was this article helpful?
    What's Next