Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-601

Snapshots fail if launching multiple connectors at once

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Major
    • 0.8.0.Beta1
    • 0.7.2
    • mysql-connector
    • None

    Description

      When launching a new connector while an existing connector is performing a snapshot, the first connector's snapshot fails. This is because the second connector launch triggers a rebalance in kafka connect. It is a known issue that a rebalance cannot take place during the initial snapshot, however we guarantee this will happen when launching multiple connectors at or around the same time.

      One solution to this would be an initial snapshot delay: after launching a connector, delay for N minutes before actually beginning the snapshot. This would allow multiple connectors to be launched at the same time and the triggered rebalancing to be completed before the N minutes.

      This could be a configurable delay period so those users with only 1 connector can opt to not have the snapshot delay at all.

      Attachments

        Activity

          People

            pgoransson@cainc.com Peter Goransson (Inactive)
            pgoransson@cainc.com Peter Goransson (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: