summary
Help Page for ETL Configuration of Data Settings from Amazon Redshift.
constraints
- none in particular
STEP1 Basic settings
| (data) item | indispensable | default value | Contents |
|---|---|---|---|
| Amazon Redshift Connection Configuration | Yes | - | From the pre-registered Amazon Redshift Connection Configuration, select the one that has the necessary permissions for this ETL Configuration. |
| database | Yes | - | Enter the name of the database containing the data you wish to retrieve. |
| schema | Yes | public | Enter the name of the schema containing the data you wish to retrieve. You can also load a list from the Load Schema List. |
| query | Yes | - | Enter a query to retrieve transfer data. |
STEP1 detailed settings
Click on Set Details to display the configuration items.
| item name | indispensable | default value | Contents |
|---|---|---|---|
| Number of records processed by the cursor at one time | Yes | 10,000 | You can specify the number of rows to be retrieved at a time by the cursor. |
| Connection timeout (sec) | Yes | 300 | You can specify the time in seconds before timeout on connection. |
| Socket timeout (seconds) | Yes | 1,800 | Socket timeout can be specified in seconds. |
When Fetch size Error occurs
If you are using a single node cluster, the following error may occur when previewing ETL Configuration STEP 2.
ERROR: Fetch size 10000 exceeds the limit of 1000 for a single node configuration.
Reduce the client fetch/cache size or upgrade to a multi node installation.
In this case, set the number of records processed by the cursor at one time to 1,000 or less.