summary
Help Page for ETL Configuration of Data Setting from MySQL.
constraints
Supported versions of MariaDB
We have confirmed the following versions of MariaDB.
- v11.0: Transfer is not supported.
- v11.1: It has been confirmed that the transfer is possible.
Transfers using versions other than MariaDB v11.1 are not supported. Please understand that we are not responsible for any loss or damage to your property.
Setting items
STEP1 Basic settings
| item name | indispensable | default value | Contents |
|---|---|---|---|
| MySQL Connection Configuration | Yes | - | Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration. |
| database | Yes | - | Enter the name of the database containing the data you wish to transfer in MySQL. You can use the auto-completion function when typing. You can also load a list of databases by pressing "Load Database List". |
| Transfer Method | Yes | Transfer using query | Select either Transfer or Incremental Data Transfer****using the query. For more information on Incremental Data Transfer, see Incremental Data Transfer Function. |
| query | Yes | - | Enter if you selected transfer using query as the transfer method. Enter SQL to retrieve transfer data. |
| table | Yes | - | Enter if Incremental Data Transfer is selected as the transfer method. Enter the name of the table containing the data you wish to transfer. |
| Default time zone | No | - | Enter the server-side time zone setting for MySQL. For example, if the time zone is Japan, enter Asia/Tokyo. |
STEP2 Detailed settings
| item name | default value | Contents |
|---|---|---|
| Number of records processed by the cursor at one time | 10000 | You can specify the number of rows to be retrieved at a time by the cursor. |
| Connection timeout (sec) | 300 | You can specify the time in seconds until timeout on connection. |
| Socket timeout (seconds) | 1800 | Socket timeout can be specified in seconds. |
supplement
If an error occurs during the transfer execution and the following message is found in the error log, the number of records processed by the cursor at one time may be too large, please decrease the value from STEP 2 and execute again.
org.embulk.exec.PartialExecutionException: java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space