Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1094

Intermittent: Mongo Debezium fails to get snapshot data

    XMLWordPrintable

Details

    • Hide

      FYI, this doesn't happens all the time.

      Show
      FYI, this doesn't happens all the time.

    Description

      Started the debezium mongo connector with the below config,

      {
      "name": "mongo-debezium-Jan212",
      "config": {
      "connector.class": "io.debezium.connector.mongodb.MongoDbConnector",
      "schema.registry.url": "http://dev-testing.com:8081",
      "bootstrap.servers": "dev-kafka01.testing.com:9091",
      "zookeeper.connect": "dev-zookeeper01.testing.com:2181",
      "tasks.max": "1",
      "mongodb.name": "devcdcJan212",
      "mongodb.hosts": "rs0/dev-avl-mongo.testing.com:27017",
      "collection.whitelist": "dbName.collectionName1,dbName.collectionName2,dbName.collectionName3,dbName.collectionName4"
      }
      }
      

      The connector says running but no data flows into topic. In logs I see this below,

      ERROR Error while attempting to sync 'rs0.dbName.collectionName1': null (io.debezium.connector.mongodb.Replicator)
      java.lang.InterruptedException
      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
      at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
      at java.util.concurrent.LinkedBlockingDeque.putLast(LinkedBlockingDeque.java:396)
      at java.util.concurrent.LinkedBlockingDeque.put(LinkedBlockingDeque.java:649)
      at io.debezium.connector.mongodb.MongoDbConnectorTask$TaskRecordQueue.enqueue(MongoDbConnectorTask.java:234)
      at io.debezium.function.BufferedBlockingConsumer$1.accept(BufferedBlockingConsumer.java:52)
      at io.debezium.connector.mongodb.Replicator$BufferableRecorder.accept(Replicator.java:532)
      at io.debezium.connector.mongodb.Replicator$BufferableRecorder.accept(Replicator.java:485)
      at io.debezium.connector.mongodb.RecordMakers$RecordsForCollection.createRecords(RecordMakers.java:198)
      at io.debezium.connector.mongodb.RecordMakers$RecordsForCollection.recordObject(RecordMakers.java:147)
      at io.debezium.connector.mongodb.Replicator.copyCollection(Replicator.java:359)
      at io.debezium.connector.mongodb.Replicator.lambda$copyCollection$5(Replicator.java:336)
      at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.executeBlocking(ConnectionContext.java:283)
      at io.debezium.connector.mongodb.Replicator.copyCollection(Replicator.java:335)
      at io.debezium.connector.mongodb.Replicator.lambda$performInitialSync$4(Replicator.java:277)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            arrajeev87 Rajeev AR (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: