Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-390 Data are read from the binlog and not written into kafka
  3. DBZ-406

Modify BinlogReader to support transactions of unlimited size

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 0.6
    • Fix Version/s: 0.7.0
    • Component/s: mysql-connector
    • Labels:
      None

      Description

      DBZ-405 enables buffering of transactions but only of limited pre-configured size. If the transaction is bigger than configured buffer than the BinlogReader shold log a WARN message. Then it should continue with processing of binlog reader till the transaction is ended.
      If the transaction ends with ROLLBACK then buffer is cleared and normal processing continues. If it ends with commit then BinaryLogClient is disconnected. A new connection is establish from the beginning of transaction and the transaction is streamed directly to Kafka. When the transaction is completed the buffering is enabled again.

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  jpechanec Jiri Pechanec
                  Reporter:
                  jpechanec Jiri Pechanec
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  1 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved: