Data Source - MySQL binlog (CDC)
  • 03 Mar 2022
  • 1 Minute to read
  • Dark
    Light

Data Source - MySQL binlog (CDC)

  • Dark
    Light

Overview

Help page for setting up a data transfer from MySQL binlog (CDC).

Supported Protocol

Data Loader: Embulk
Using the input-mysql_binlog plugin.

Limitations

Currently, MySQL binlog CDC is only supported when the data destination is set to BigQuery.

Settings

Step 1: General Settings

Field Name
Required
Default Value
Description
MySQL Connection Configuration Yes - From the MySQL Connection Configurations created in advance, select the one with the necessary permissions for this transfer.
If you have not previously created any Connection Configurations, click the Add Connection Configuration button to set up a new one.
Database Name Yes - Enter the MySQL database name containing the data you wish to transfer.
By pressing the Load Database List button, you can update your MySQL database list, used to auto-complete the field.
Table Yes - Enter the table name containing the data you wish to transfer.
Default Time Zone No - Enter the time zone set server side in MySQL.
For example, if the time zone is set as Japan use Asia/Tokyo in this field.
Schema Sync Yes Disabled Schema Sync is a feature which automatically synchronizes schema changes between the data source and destination.
When enabled, if schema changes, and/or row changes (additions, deletions, updates etc.), have been made in MySQL, they will be automatically synchronized in BigQuery.
For example, if a new column col_new is added in MySQL, with schema sync enabled, the column col_new will also be added in BigQuery.
For information regarding default types, please refer to trocco’s Schema Types in MySQL and BigQuery support document.

Was this article helpful?