Data Destination - SFTP
- 06 Dec 2022
- Print
- DarkLight
- PDF
Data Destination - SFTP
- Updated on 06 Dec 2022
- Print
- DarkLight
- PDF
Article Summary
Share feedback
Thanks for sharing your feedback!
Overview
Help page for setting up a data transfer to a SFTP location.
Supported Protocol
- Dataloader: Embulk
- Using the embulk-output-sftp plugin
Limitations
None.
Settings
Step 1: General Settings
SFTP Connection Configuration | Yes | - | From the SFTP Connection Configuration created in advance, select the one with the required permissions for this transfer. If you have not previously created any Connection Configurations, click the Add Connection Configuration button to set up a new one. |
Path Prefix | Yes | - | Specify the path prefix at the destination for the data that you wish to transfer. Be sure to put a forward slash ( / ) at the beginning of the path prefix, otherwise an error will occur. You can use custom variables to embed a value that will be dynamically set when the job executes. |
Output Filename Extension | Yes | .csv | Specify the output filename extention. Please match it with the format of the file that will be output. |
Output File Format | Yes | CSV/TSV | Specify the format of the file to be output. You can choose between the CSV/TSV and JSON Lines file formats. |
File Compression | No | - | If you wish to compress your files, you can select between the gzip or bzip2 compression methods. |
Transfer Mode | Yes | Parallel Transfer | Select between the Parallel Transfer or Limit Output File Count transfer modes. When Limit Output File Count mode is selected, internally trocco will limit the output file count corresponding with the input file. For example, a single file from the data source will be transferred, and output also as a single file in the destination. |
Was this article helpful?