Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1021

Postgres connector fails upon event of recently deleted table

    XMLWordPrintable

    Details

      Description

      Sadly, I cannot find any useful information in the log. Everything worked until recently, I think. There's several other connectors that work alright. Restarting the connector several times didn't help. I will go and try to downgrade to Alpha2 now.

      Unable to find source-code formatter for language: text. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yaml
      2018-12-03 12:20:15,879 - ERROR [debezium-postgresconnector-somedb-records-stream-producer:RecordsStreamProducer@143] - unexpected exception while streaming logical changes
      java.lang.NullPointerException
              at io.debezium.relational.TableImpl.<init>(TableImpl.java:26)
              at io.debezium.relational.Tables.lambda$overwriteTable$3(Tables.java:169)
              at io.debezium.util.FunctionalReadWriteLock.write(FunctionalReadWriteLock.java:82)
              at io.debezium.relational.Tables.overwriteTable(Tables.java:168)
              at io.debezium.connector.postgresql.PostgresSchema.refresh(PostgresSchema.java:121)
              at io.debezium.connector.postgresql.RecordsStreamProducer.tableSchemaFor(RecordsStreamProducer.java:561)
              at io.debezium.connector.postgresql.RecordsStreamProducer.process(RecordsStreamProducer.java:249)
              at io.debezium.connector.postgresql.RecordsStreamProducer.lambda$streamChanges$1(RecordsStreamProducer.java:131)
              at io.debezium.connector.postgresql.connection.pgproto.PgProtoMessageDecoder.processMessage(PgProtoMessageDecoder.java:48)
              at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.deserializeMessages(PostgresReplicationConnection.java:235)
              at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.read(PostgresReplicationConnection.java:220)
              at io.debezium.connector.postgresql.RecordsStreamProducer.streamChanges(RecordsStreamProducer.java:131)
              at io.debezium.connector.postgresql.RecordsStreamProducer.lambda$start$0(RecordsStreamProducer.java:117)
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at java.lang.Thread.run(Thread.java:748)
      2018-12-03 12:20:15,984 - INFO  [pool-7-thread-5:WorkerSourceTask@397] - WorkerSourceTask{id=somedb-connector-0} Committing offsets
      2018-12-03 12:20:15,985 - INFO  [pool-7-thread-5:WorkerSourceTask@414] - WorkerSourceTask{id=somedb-connector-0} flushing 0 outstanding messages for offset commit
      2018-12-03 12:20:15,985 - ERROR [pool-7-thread-5:WorkerTask@177] - WorkerSourceTask{id=somedb-connector-0} Task threw an uncaught and unrecoverable exception
      org.apache.kafka.connect.errors.ConnectException: An exception ocurred in the change event producer. This connector will be stopped.
              at io.debezium.connector.base.ChangeEventQueue.throwProducerFailureIfPresent(ChangeEventQueue.java:168)
              at io.debezium.connector.base.ChangeEventQueue.poll(ChangeEventQueue.java:149)
              at io.debezium.connector.postgresql.PostgresConnectorTask.poll(PostgresConnectorTask.java:156)
              at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:244)
              at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:220)
              at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:175)
              at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:219)
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at java.lang.Thread.run(Thread.java:748)
      Caused by: java.lang.NullPointerException
              at io.debezium.relational.TableImpl.<init>(TableImpl.java:26)
              at io.debezium.relational.Tables.lambda$overwriteTable$3(Tables.java:169)
              at io.debezium.util.FunctionalReadWriteLock.write(FunctionalReadWriteLock.java:82)
              at io.debezium.relational.Tables.overwriteTable(Tables.java:168)
              at io.debezium.connector.postgresql.PostgresSchema.refresh(PostgresSchema.java:121)
              at io.debezium.connector.postgresql.RecordsStreamProducer.tableSchemaFor(RecordsStreamProducer.java:561)
              at io.debezium.connector.postgresql.RecordsStreamProducer.process(RecordsStreamProducer.java:249)
              at io.debezium.connector.postgresql.RecordsStreamProducer.lambda$streamChanges$1(RecordsStreamProducer.java:131)
              at io.debezium.connector.postgresql.connection.pgproto.PgProtoMessageDecoder.processMessage(PgProtoMessageDecoder.java:48)
              at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.deserializeMessages(PostgresReplicationConnection.java:235)
              at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.read(PostgresReplicationConnection.java:220)
              at io.debezium.connector.postgresql.RecordsStreamProducer.streamChanges(RecordsStreamProducer.java:131)
              at io.debezium.connector.postgresql.RecordsStreamProducer.lambda$start$0(RecordsStreamProducer.java:117)
              ... 5 more
      2018-12-03 12:20:15,986 - ERROR [pool-7-thread-5:WorkerTask@178] - WorkerSourceTask{id=somedb-connector-0} Task is being killed and will not recover until manually restarted
      
      

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                jpechanec Jiri Pechanec
                Reporter:
                analytik Milan Brezovsky
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: