Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-390 Data are read from the binlog and not written into kafka
  3. DBZ-406

Modify BinlogReader to support transactions of unlimited size

    XMLWordPrintable

Details

    • Sub-task
    • Resolution: Done
    • Major
    • 0.7.0
    • 0.6
    • mysql-connector
    • None

    Description

      DBZ-405 enables buffering of transactions but only of limited pre-configured size. If the transaction is bigger than configured buffer than the BinlogReader shold log a WARN message. Then it should continue with processing of binlog reader till the transaction is ended.
      If the transaction ends with ROLLBACK then buffer is cleared and normal processing continues. If it ends with commit then BinaryLogClient is disconnected. A new connection is establish from the beginning of transaction and the transaction is streamed directly to Kafka. When the transaction is completed the buffering is enabled again.

      Attachments

        Issue Links

          Activity

            People

              jpechane Jiri Pechanec
              jpechane Jiri Pechanec
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: