Data Source - MySQL

constraints

Supported versions of MariaDB

We have confirmed the following versions of MariaDB.

v11.0: Transfer is not supported.
v11.1: It has been confirmed that the transfer is possible.

Transfers using versions other than MariaDB v11.1 are not supported. Please understand that we are not responsible for any loss or damage to your property.

Setting items

STEP1 Basic settings

item name	indispensable	default value	Contents
MySQL Connection Configuration	Yes	-	Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.
database	Yes	-	Enter the name of the database containing the data you wish to transfer in MySQL. You can use the auto-completion function when typing. You can also load a list of databases by pressing "Load Database List".
Transfer Method	Yes	Transfer using query	Select either Transfer or Incremental Data Transferusing the query. For more information on Incremental Data Transfer, see Incremental Data Transfer Function.
query	Yes	-	Enter if you selected transfer using query as the transfer method. Enter SQL to retrieve transfer data.
table	Yes	-	Enter if Incremental Data Transfer is selected as the transfer method. Enter the name of the table containing the data you wish to transfer.
Default time zone	No	-	Enter the server-side time zone setting for MySQL. For example, if the time zone is Japan, enter Asia/Tokyo.

item name

indispensable

default value

Contents

MySQL Connection Configuration

Yes

Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.

database

Yes

Enter the name of the database containing the data you wish to transfer in MySQL.
You can use the auto-completion function when typing.
You can also load a list of databases by pressing "Load Database List".

Transfer Method

Yes

Transfer using query

Select either Transfer or Incremental Data Transfer****using the query.
For more information on Incremental Data Transfer, see Incremental Data Transfer Function.

query

Yes

Enter if you selected transfer using query as the transfer method.
Enter SQL to retrieve transfer data.

table

Yes

Enter if Incremental Data Transfer is selected as the transfer method.
Enter the name of the table containing the data you wish to transfer.

Default time zone

Enter the server-side time zone setting for MySQL.
For example, if the time zone is Japan, enter Asia/Tokyo.

STEP2 Detailed settings

item name	default value	Contents
Number of records processed by the cursor at one time	10000	You can specify the number of rows to be retrieved at a time by the cursor.
Connection timeout (sec)	300	You can specify the time in seconds until timeout on connection.
Socket timeout (seconds)	1800	Socket timeout can be specified in seconds.

item name

default value

Contents

Number of records processed by the cursor at one time

10000

You can specify the number of rows to be retrieved at a time by the cursor.

Connection timeout (sec)

300

You can specify the time in seconds until timeout on connection.

Socket timeout (seconds)

1800

Socket timeout can be specified in seconds.

supplement

If an error occurs during the transfer execution and the following message is found in the error log, the number of records processed by the cursor at one time may be too large, please decrease the value from STEP 2 and execute again.

org.embulk.exec.PartialExecutionException: java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space

Data Source - MySQL

summary

constraints

Setting items

STEP1 Basic settings

STEP2 Detailed settings

supplement

What's Next