Data Source - SFTP
  • 11 Apr 2022
  • 1 Minute to read
  • Dark
    Light

Data Source - SFTP

  • Dark
    Light

Overview

Help page for setting up a data transfer from an SFTP server.

Supported Protocol

Data Loader: Embulk
Using the embulk-input-sftp plugin.

Limitations

None.

Settings

Step 1: General Settings

Field Name
Required
Default Value
Description
SFTP Connection Configuration Yes - From the SFTP Connection Configurations created in advance, select the one with the necessary permissions for this transfer.
If you have not previously created any Connection Configurations, click the Add Connection Configuration button to set up a new one.
Path Prefix Yes - Specify the path prefix for the data you wish to transfer.
Be sure to put a forward slash ( / ) at the beginning of the path prefix otherwise an error will occur.
In this field, you can use custom variables to embed a value that will be dynamically set when the job executes.
Input File Format Yes CSV/TSV Specify the input file format from the following options:

  • CSV/TSV
  • JSON Lines
  • JSONPath
  • LTSV
  • Transfer Method Yes Full Load Choose between Full Load or Incremental Load transfer methods.
    If Incremental Load is selected, only incremental data since the previous job will be transferred.

    Was this article helpful?