Data Source - Amazon Redshift
    • PDF

    Data Source - Amazon Redshift

    • PDF

    Article summary

    summary

    Help Page for ETL Configuration of Data Settings from Amazon Redshift.

    constraints

    • none in particular

    STEP1 Basic settings

    (data) itemindispensabledefault valueContents
    Amazon Redshift Connection ConfigurationYes-From the pre-registered Amazon Redshift Connection Configuration, select the one that has the necessary permissions for this ETL Configuration.
    databaseYes-Enter the name of the database containing the data you wish to retrieve.
    schemaYespublicEnter the name of the schema containing the data you wish to retrieve.
    You can also load a list from the Load Schema List.
    queryYes-Enter a query to retrieve transfer data.

    STEP1 detailed settings

    Click on Set Details to display the configuration items.

    item nameindispensabledefault valueContents
    Number of records processed by the cursor at one timeYes10,000You can specify the number of rows to be retrieved at a time by the cursor.
    Connection timeout (sec)Yes300You can specify the time in seconds before timeout on connection.
    Socket timeout (seconds)Yes1,800Socket timeout can be specified in seconds.
    When Fetch size Error occurs

    If you are using a single node cluster, the following error may occur when previewing ETL Configuration STEP 2.

    ERROR: Fetch size 10000 exceeds the limit of 1000 for a single node configuration.
    Reduce the client fetch/cache size or upgrade to a multi node installation.
    

    In this case, set the number of records processed by the cursor at one time to 1,000 or less.


    Was this article helpful?