Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3595

Pulsar sink tries to convert null key to string

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 1.6.0.Beta2
    • 1.5.2.Final
    • debezium-server
    • None

    Description

      I'm using debezium server to CDC the table data from oracle to pulsar.when I run the script run.sh,I got the error

      message " 2021-06-07 17:39:09,887 INFO [io.deb.ser.ConnectorLifecycle] (pool-3-thread-1) Connector completed: success = 'false', message = 'Stopping connector after error in the application's handler method: Unexpected data type 'null'', error = '{}': io.debezium.DebeziumException: Unexpected data type 'null'
      at io.debezium.server.BaseChangeConsumer.getString(BaseChangeConsumer.java:71)
      at io.debezium.server.pulsar.PulsarChangeConsumer.handleBatch(PulsarChangeConsumer.java:123)
      at io.debezium.embedded.ConvertingEngineBuilder.lambda$notifying$2(ConvertingEngineBuilder.java:83)
      at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:821)
      at io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188)
      at io.debezium.server.DebeziumServer.lambda$start$1(DebeziumServer.java:142)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)"
      

      I think the reason is the source table has none primary key.

      Then I got the solution by Naros to use oracle connector parameter "message.key.columns".

      Why  the property "debezium.sink.pulsar.null.key" can not resove this?

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            happyshf Tim Xu (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: