Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4029

Support for heartbeat action queries for MySQL

XMLWordPrintable

      Hi team,

      We have a usecase where we are replicating mysql transactions along with 100 tables from a source and gtid enabled. These cdc events are then pushed into snowflake using a snowflake connector. The cdc events from the history tables are then loaded into staging tables using the GTIDs as watermarks.

      Usually the UUID portion in the GTID doesn't change and the transaction id is continually incrementing. But in the scenario when the mysql topology changes, the UUID and the transaction id changes. We need a way to be aware of this event when it happens so we can start using the new GTID to continue loading the events to staging.

      Is there a heartbeat event that can run every minute and detect this change and generate a new event with the new GTID? Something similar to what was done for (postgres)https://github.com/debezium/debezium/pull/1309/files?

            Unassigned Unassigned
            abhishekkh-1 Abhishek Hodavdekar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: