Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1971

Offset storage contract should be independent of Kafka Connect

XMLWordPrintable

      Embedded engine and Debezium Server currently re-use the OffsetBackingStore contract from Kafka Connect. That can be confusing when implementing a custom store. We therefore should provide a Debezium-specific contract instead. This also applies to the configuration properties used e.g. to configure the file based store with the embedded engine.

      One specific requirement we should address is to avoid the usage of FQNs in the configuration. Instead, each implementation should expose a short name such as "file", "kafka", "dynamodb" etc. This would be retrieved from a store-specific factory which is discovered via the service loader. In the configuration then those short names woul be used by default, and the engine looks up the right implementation via the service loader. FQNs might still be supported as a fallback, should there be multiple implementations exposing the same short name.

            jpechane Jiri Pechanec
            gunnar.morling Gunnar Morling
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: