Contents x
    Data Source - SFTP
    • 11 Apr 2022
    • Print
    • Dark
      Light
    • PDF
    Contents

    Data Source - SFTP

    • Updated on 11 Apr 2022
    • Print
    • Dark
      Light
    • PDF
    Article Summary

    Overview

    Help page for setting up a data transfer from an SFTP server.

    Supported Protocol

    Data Loader: Embulk
    Using the embulk-input-sftp plugin.

    Limitations

    None.

    Settings

    Step 1: General Settings

    Field Name
    Required
    Default Value
    Description
    SFTP Connection ConfigurationYes-From the SFTP Connection Configurations created in advance, select the one with the necessary permissions for this transfer.
    If you have not previously created any Connection Configurations, click the Add Connection Configuration button to set up a new one.
    Path PrefixYes-Specify the path prefix for the data you wish to transfer.
    Be sure to put a forward slash ( / ) at the beginning of the path prefix otherwise an error will occur.
    In this field, you can use custom variables to embed a value that will be dynamically set when the job executes.
    Input File FormatYesCSV/TSVSpecify the input file format from the following options:

  • CSV/TSV
  • JSON Lines
  • JSONPath
  • LTSV
    • Transfer MethodYesFull LoadChoose between Full Load or Incremental Load transfer methods.
    If Incremental Load is selected, only incremental data since the previous job will be transferred.
    Was this article helpful?
    What's Next