Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-712

Mongo Connector - doesn't redo initial sync after connector restart

    XMLWordPrintable

    Details

      Description

      Found the issue that when initial sync is interrupted by a restart (or task rebalance), and after restart it doesn't redo the initial sync and start with reading oplog.

      After some investigation, it turns out the root cause is during initial sync, it'll commit offset with initsync:true, but when reading the offset during connector creation, it just ignores that flag and takes this offset as valid ones in the code below:
      https://github.com/debezium/debezium/blob/master/debezium-connector-mongodb/src/main/java/io/debezium/connector/mongodb/SourceInfo.java#L295:LL304

      I created a pull request to fix it: https://github.com/debezium/debezium/pull/527

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                echo.xu Echo Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: