Configure a self-managed MySQL database

The following sections cover how to configure CDC for a self-managed MySQL database. These instructions also work for databases such as MariaDB, Percona Server for MySQL or Alibaba Cloud PolarDB.

Verify the configuration and retention period of the binary log

1. Confirm that the binary log is configured correctly by entering the following MySQL command:

   SHOW GLOBAL VARIABLES LIKE '%binlog_format%';
   

2. Verify that the value for the binlog_format variable is set to ROW. Datastream doesn't support MIXED or STATEMENT binary log formats.

3. Confirm that the row format for the binary log is set to FULL by entering the following MySQL command:

   SHOW GLOBAL VARIABLES LIKE 'binlog_row_image';
   

4. Verify that the replica updates option for the binary log is set to ON by entering the following MySQL command:

   SHOW GLOBAL VARIABLES LIKE 'log_replica_updates';
   

   For MySQL versions earlier than 8.0.26, enter the following command instead:

   SHOW GLOBAL VARIABLES LIKE 'log_slave_updates';
   

5. Verify that the retention period of the binary log is set to 604800 seconds (7 days) by entering the following MySQL command:

   SHOW GLOBAL VARIABLES LIKE 'binlog_expire_logs_seconds';
   

   For MySQL versions earlier than 8.0.3, enter the following command instead:

   SHOW GLOBAL VARIABLES LIKE 'expire_logs_days';
   

   If your MySQL database isn't set to full row-based replication and a 7-day retention period, then you'll need to change the configuration of the binary log, as follows:

   1. Navigate to the /etc/mysql/ directory.
   2. Using an editor, open the my.cnf file.
   3. Add the following lines to the file:

        [mysqld]
        log-bin=mysql-bin
        server-id=1
        binlog_format=ROW
        log-replica-updates=1
        # For MySQL versions earlier than 8.0.26, use log-slave-updates=true
        # instead.
        binlog_expire_logs_seconds=604800
        # For MySQL versions earlier than 8.0.3, use expire_logs_days=7 instead.
        max_allowed_packet=1G
        # '1G' is the recommended value.
        

   4. For GTID-based replication, also add the following lines:

        [mysqld]
        gtid_mode=ON
        enforce-gtid-consistency=ON
        

   5. Save your changes to the my.cnf file, and then close the file.
   6. Restart your MySQL server so that the changes you made can take effect.

Create a Datastream user

1. To create a Datastream user, enter the following MySQL commands:

   CREATE USER 'datastream'@'%' IDENTIFIED BY 'YOUR_PASSWORD';
   GRANT REPLICATION SLAVE, SELECT, REPLICATION CLIENT ON *.* TO 'datastream'@'%';
   FLUSH PRIVILEGES;

What's next

• Learn more about how Datastream works with MySQL sources.