Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2662

Control ChangeEventQueue by the size in bytes

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Done
    • Icon: Major Major
    • 1.4.0.Alpha2
    • 1.3.0.Final
    • core-library
    • None
    • False
    • False
    • 0
    • 0% 0%
    • Undefined

      Hi Team,

       

      We are using debezium server with postgres connector, and the issue we are facing is that the database that we subscribe to having a lot of records with big size in bytes each.

      We know that the platform is providing a way to control the number of messages that will be buffered in memory (`max.queue.size`). So we are requesting a feature that also has an option to cache messages in bytes with a specific threshold similar to max.queue.size parameter. And then we can combine 2 of those parameters together.

      With this feature, we will avoid Java Heap Memory issue since we don't have knowledge of the message size in bytes.

       

      Thanks,

      Hoa.

            Unassigned Unassigned
            vanhoael Hoa Le (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: