Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2417

Error in LSN

XMLWordPrintable

    • Hide

      Start the Debezium connector on SQL Server Database.

      Wait to finish the snapshot

      About two days with Debezium working fine the error occurs.

      Show
      Start the Debezium connector on SQL Server Database. Wait to finish the snapshot About two days with Debezium working fine the error occurs.

      After using Debezium as replicator for two days, the following error occurs:

       

      org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42) at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:268) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.IllegalStateException: The update before event at 00028ba5:0000320c:0002(00028ba3:0001e3f4:0001) for table PROTHEUS_PRODUCAO.dbo.SA1010 was not followed by after event. Please report this as a bug together with a events around given LSN. at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.lambda$execute$1(SqlServerStreamingChangeEventSource.java:234) at io.debezium.jdbc.JdbcConnection.prepareQuery(JdbcConnection.java:524) at io.debezium.connector.sqlserver.SqlServerConnection.getChangesForTables(SqlServerConnection.java:190) at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:162) ... 6 more

       

       

      Tried to restart Debezium connector but without success. 

      Running apache Kafka v 2.4.1 with connectDistributed using Debezium as source connector:

       

      Follow the details about source connector:

      connector.class io.debezium.connector.sqlserver.SqlServerConnector
      database.user replicador
      database.dbname PROTHEUS_PRODUCAO
      enable.idempotence true
      tasks.max 1
      database.history.kafka.bootstrap.servers 192.168.240.70:9092,192.168.240.71:9092,192.168.240.72:9092,192.168.240.73:9092,192.168.240.74:9092
      database.history.kafka.topic dbreplication.protheus
      acks all
      transforms route
      database.server.name protheus
      bootstrap.servers 192.168.240.70:9092,192.168.240.71:9092,192.168.240.72:9092,192.168.240.73:9092,192.168.240.74:9092
      database.port 1433
      table.whitelist dbo.SQB010,dbo.AD6010,dbo.ACO010,dbo.ACP010,dbo.ACH010,dbo.ACY010,dbo.CC2010,dbo.CD2010,dbo.CTT010,dbo.DA1010,dbo.DAI010,dbo.DAK010,dbo.SA1010,dbo.SA2010,dbo.SA3010,dbo.SA4010,dbo.SA7010,dbo.SAH010,dbo.SB1010,dbo.SB2010,dbo.SB3010,dbo.SB4010,dbo.SB6010,dbo.SB7010,dbo.SB8010,dbo.SB9010,dbo.SBE010,dbo.SBF010,dbo.SBM010,dbo.SC1010,dbo.SC2010,dbo.SC5010,dbo.SC6010,dbo.SC7010,dbo.SC9010,dbo.SCP010,dbo.SCT010,dbo.SD1010,dbo.SD2010,dbo.SD3010,dbo.SDA010,dbo.SDB010,dbo.SDC010,dbo.SDD010,dbo.SE1010,dbo.SE2010,dbo.SE3010,dbo.SE4010,dbo.SE5010,dbo.SED010,dbo.SF1010,dbo.SF2010,dbo.SF3010,dbo.SF4010,dbo.SF5010,dbo.SG1010,dbo.SJ0010,dbo.SP3010,dbo.SPC010,dbo.SPH010,dbo.SRA010,dbo.SRD010,dbo.SRJ010,dbo.SRV010,dbo.SU5010,dbo.SU7010,dbo.SUA010,dbo.SUB010,dbo.SW0010,dbo.SW1010,dbo.SW2010,dbo.SW3010,dbo.SW4010,dbo.SW5010,dbo.SW6010,dbo.SW7010,dbo.SW8010,dbo.SW9010,dbo.SWA010,dbo.SWB010,dbo.SWD010,dbo.SWP010,dbo.SX5010,dbo.SY4010,dbo.SY6010,dbo.SYA010,dbo.SYB010,dbo.SYD010,dbo.SYE010,dbo.SYP010,dbo.SYQ010,dbo.SZ1010,dbo.SZ2010,dbo.SZ3010,dbo.SZ4010,dbo.SZ9010,dbo.SZB010,dbo.SZC010,dbo.SZI010,dbo.SZJ010,dbo.SZK010,dbo.SZN010,dbo.ZB1010,dbo.ZB2010,dbo.ZB3010,dbo.ZB5010,dbo.ZB6010,dbo.ZP0010,dbo.ZP1010,dbo.ZP2010,dbo.ZP4010,dbo.ZZA010,dbo.ZZC010,dbo.ZZF010,dbo.ZZG010,dbo.ZZH010,dbo.SPED050,dbo.SPED054,dbo.SP9010
      transforms.route.type org.apache.kafka.connect.transforms.RegexRouter
      transforms.route.regex ([^.])\.([^.])\.([^.]+)
      task.class io.debezium.connector.sqlserver.SqlServerConnectorTask
      database.hostname ***
      database.password ***
      name source-protheus
      transforms.route.replacement $3

       

       

       

            jpechane Jiri Pechanec
            wplopes WILLIAM LOPES (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: