Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-443

New snapshotting mode for recovery of DB history topic

    XMLWordPrintable

    Details

    • Type: Feature Request
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 0.7.2
    • Component/s: mysql-connector
    • Labels:
      None

      Description

      Our organization spoke with Randall Hauch last week to discuss the options for recovering the db-history topic should it be lost or corrupted in some way.

      Our schemas do not change very often (every couple weeks at most), so we are in a situation where if we lost the db-history topic, we could theoretically use the schema_only mode to regenerate this topic. However, when we tried this, the snapshot stamps the current binlog position for all the generated DDL statements. So when we restart the connector pointing to the new db-history topic, it cannot pickup at the position it left off because it has no DDL history yet at this position.

      So we discussed the possibility of a implementing "forced" schema_only mode. This would re-snapshot the schema only for a running connector, and set the binlog position for the generated DDL to the current position of the connector.

      This will only work in a use case where we know there have been no effective DDL changes during the recovery period.

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  pgoransson Peter Goransson
                  Reporter:
                  pgoransson Peter Goransson
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: