Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1443

MySQL connector stops processing with an exception

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • None
    • 0.8.3.Final
    • mysql-connector
    • None

    Description

      Getting the following exception.

      [2019-08-22 05:51:32,432] ERROR Error during binlog processing. Last offset stored = {ts_sec=1566442824, file=mysql-bin-changelog.009184, pos=72227478, server_id=241308800, event=1}, binlog reader near position = mysql-bin-changelog.009184/72248246 (io.debezium.connector.mysql.BinlogReader)
      [2019-08-22 05:51:32,432] ERROR Failed due to error: Error processing binlog event (io.debezium.connector.mysql.BinlogReader)
      org.apache.kafka.connect.errors.ConnectException: Invalid default value
      	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200)
      	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178)
      	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:452)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793)
      	at java.lang.Thread.run(Thread.java:748)
      Caused by: org.apache.kafka.connect.errors.SchemaBuilderException: Invalid default value
      	at org.apache.kafka.connect.data.SchemaBuilder.defaultValue(SchemaBuilder.java:131)
      	at io.debezium.relational.TableSchemaBuilder.addField(TableSchemaBuilder.java:307)
      	at io.debezium.relational.TableSchemaBuilder.lambda$create$0(TableSchemaBuilder.java:103)
      	at java.util.ArrayList.forEach(ArrayList.java:1257)
      	at java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1080)
      	at java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1080)
      	at io.debezium.relational.TableSchemaBuilder.create(TableSchemaBuilder.java:94)
      	at io.debezium.relational.RelationalDatabaseSchema.buildAndRegisterSchema(RelationalDatabaseSchema.java:112)
      	at io.debezium.connector.mysql.MySqlSchema.lambda$applyDdl$3(MySqlSchema.java:361)
      	at java.lang.Iterable.forEach(Iterable.java:75)
      	at io.debezium.connector.mysql.MySqlSchema.applyDdl(MySqlSchema.java:355)
      	at io.debezium.connector.mysql.BinlogReader.handleQueryEvent(BinlogReader.java:637)
      	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:436)
      	... 5 more
      Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "null", schema type: STRING
      	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220)
      	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:213)
      	at org.apache.kafka.connect.data.SchemaBuilder.defaultValue(SchemaBuilder.java:129)
      	... 17 more
      [2019-08-22 05:51:32,433] INFO Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored. (io.debezium.connector.mysql.BinlogReader)
      [2019-08-22 05:51:32,713] INFO WorkerSourceTask{id=mysql-source-connector-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask)
      [2019-08-22 05:51:32,713] INFO WorkerSourceTask{id=mysql-source-connector-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask)
      [2019-08-22 05:51:32,717] INFO WorkerSourceTask{id=mysql-source-connector-0} Finished commitOffsets successfully in 4 ms (org.apache.kafka.connect.runtime.WorkerSourceTask)
      [2019-08-22 05:51:32,717] ERROR WorkerSourceTask{id=mysql-source-connector-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask)
      org.apache.kafka.connect.errors.ConnectException: Invalid default value
      	at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:200)
      	at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:178)
      	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:452)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1055)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:913)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:559)
      	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:793)
      	at java.lang.Thread.run(Thread.java:748)
      Caused by: org.apache.kafka.connect.errors.SchemaBuilderException: Invalid default value
      	at org.apache.kafka.connect.data.SchemaBuilder.defaultValue(SchemaBuilder.java:131)
      	at io.debezium.relational.TableSchemaBuilder.addField(TableSchemaBuilder.java:307)
      	at io.debezium.relational.TableSchemaBuilder.lambda$create$0(TableSchemaBuilder.java:103)
      	at java.util.ArrayList.forEach(ArrayList.java:1257)
      	at java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1080)
      	at java.util.Collections$UnmodifiableCollection.forEach(Collections.java:1080)
      	at io.debezium.relational.TableSchemaBuilder.create(TableSchemaBuilder.java:94)
      	at io.debezium.relational.RelationalDatabaseSchema.buildAndRegisterSchema(RelationalDatabaseSchema.java:112)
      	at io.debezium.connector.mysql.MySqlSchema.lambda$applyDdl$3(MySqlSchema.java:361)
      	at java.lang.Iterable.forEach(Iterable.java:75)
      	at io.debezium.connector.mysql.MySqlSchema.applyDdl(MySqlSchema.java:355)
      	at io.debezium.connector.mysql.BinlogReader.handleQueryEvent(BinlogReader.java:637)
      	at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:436)
      	... 5 more
      Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "null", schema type: STRING
      	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220)
      	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:213)
      	at org.apache.kafka.connect.data.SchemaBuilder.defaultValue(SchemaBuilder.java:129)
      	... 17 more
      [2019-08-22 05:51:32,717] ERROR WorkerSourceTask{id=mysql-source-connector-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
      

      Please note that we can't update to the 0.9 major release because of another bug DBZ-1246, which is fixed but only included in the 0.10 major releases

      Please let me know if you need more information about this issue

      Attachments

        Activity

          People

            Unassigned Unassigned
            tamas.szasz Tamas Szasz (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: