Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-639

Data-inclusive snapshot without table locks (For RDS/Aurora)

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 0.8.0.Beta1
    • None
    • mysql-connector
    • None

    Description

      Currently with the restrictions that RDS and Aurora impose, no global locks are allowed at a database level because of this, tables are locked to get a snapshot blocking writes.

      This step is very important because it lets debezium create consistent snapshots but it may become as issue for use cases when systems need to be available always and blocking writes is not a feasible option.

      From my understanding, the locks are held so that the DDL isn't changed when snapshot is being taken otherwise the connector's attempt to read the binlog would get hampered. But for systems, where the users can control the DDL change etc(basically maintain the DB).

      Proposition:
      Provide a new flag which lets users to create snapshots without locking the tables. This way users can control the production of data to those databases, can ensure that while snapshots are being taken, no DDL changes etc are applied while writes are still not blocked. By default this flag would be set to false but if set to true, would do a lockless snapshot.

      Attachments

        Activity

          People

            Unassigned Unassigned
            vamossagar12 Sagar Rao (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: