Data Source - FTP/FTPS
  • 23 Mar 2022
  • Dark
    Light
  • PDF

Data Source - FTP/FTPS

  • Dark
    Light
  • PDF

Article Summary

Overview

Help page for setting up a data transfer from an FTP/FTPS server.

Supported Protocol

Data Loader: Embulk
Using the embulk-input-ftp plugin.

Limitations

None.

Settings

STEP 1: General Settings

Field Name
Required
Default Value
Description
FTP/FTPS Connection ConfigurationYes-From the FTP Connection Configurations created in advance, select the one with the necessary permissions for this transfer.
If you have not previously created any Connection Configurations, click the Add Connection Configuration button to set up a new one.
Path PrefixYes-Specify the source path prefix for the data that you wish to transfer.
Note: Be sure to put a forward slash ( / ) at the beginning of the path prefix otherwise an error will occur.
You can use custom variables to embed a value that will be dynamically set when the job executes.
Input File FormatYesCSV/TSVSpecify the input file format from the following options:
  • CSV/TSV
  • JSON Lines
  • JSON Path
  • LTSV
  • CSV/TSV File FormatYes (when the Input File Format is set to CSV/TSV)CSV/TSV file with header rowsSpecify the CSV file format from:
  • CSV/TSV file with header rows
  • CSV/TSV file without header rows
  • Transfer MethodYesFull LoadChoose between the Full Load or Incremental Load transfer methods.
    If Incremental Load is selected, only new data since the previous job will be transferred.

    Was this article helpful?