Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-672

Mongo cursor cleanup

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 0.8.0.Beta1
    • 0.7.5
    • mongodb-connector
    • None

      Currently the mongo connector opens a cursor to the oplog without timeout: https://github.com/debezium/debezium/blob/master/debezium-connector-mongodb/src/main/java/io/debezium/connector/mongodb/Replicator.java#L402

      This cursor does not get closed on task shutdown and since there's no timeout mongo itself will not close it ever too, thus we see ever increasing cursor counts.

      Proper closing of the cursor only solves the problem partially as task crashes will leave hanging cursors indefinitely, so maybe a timeout is needed after all ?

        1. threads.png
          126 kB
          Saulius Valatka

            Unassigned Unassigned
            saulius_vl Saulius Valatka (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: