Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7631

Provide partition mode to guarantee order of events in same partition

XMLWordPrintable

    • Icon: Enhancement Enhancement
    • Resolution: Done
    • Icon: Major Major
    • 2.6.0.CR1
    • None
    • cassandra-connector
    • None

      Which use case/requirement will be addressed by the proposed feature?

       

      When a connector reads commit logs, it processes them sequentially and inserts them into event queues. Currently, if there are multiple queues, events are distributed among the queues based on the hash of the file name. This behavior can result in messages from subsequent files being inserted into the Kafka broker before messages from the current file, which is not desirable.

      Implementation ideas (optional)

      I propose to change the hashing strategy to use the value of partition columns to guarantee the order of events within the same partitions.

       

      I will submit a PR myself for this issue.

            Unassigned Unassigned
            samssh Amir mohammad Sadat shokouhi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: