Summary
This is a help page for ETL Configuration of Data Settings for ETL Configuration from Databricks.
Available Cloud Environments
Data Source and Data Destination Databricks is available in any of the following cloud environments.
TROCCO uses Unity Catalog Volume as temporary file storage during data transfer, so it does not depend on storage services or interfaces specific to each cloud service.
Constraints
Unavailable Data Types
- The following types are unsupported and cannot transfer values from columns.
TIMESTAMP_NTZ（Currently TIMESTAMP_NTZ type is not yet supported in JDBC Drivers）BINARY
Setting items
STEP1 Basic settings
| item name | indispensable | Contents |
|---|---|---|
| Databricks Connection Configuration | Yes | Select the preregistered Databricks Connection Configuration that has the necessary permissions for this ETL Configuration. |
| Catalog | Yes | Enter a catalog name. |
| Schema | Yes | Enter a schema name. |
| Query | Yes | Enter a query to retrieve transfer data. |
STEP1 detailed settings
Click on Set Details to display the configuration items.
| item name | indispensable | default value | Contents |
|---|---|---|---|
| Number of records processed by the cursor at one time | Yes | 10,000 | You can specify the number of rows to be retrieved at a time by the cursor. |