Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2417

Error in LSN

    XMLWordPrintable

Details

    • Hide

      Start the Debezium connector on SQL Server Database.

      Wait to finish the snapshot

      About two days with Debezium working fine the error occurs.

      Show
      Start the Debezium connector on SQL Server Database. Wait to finish the snapshot About two days with Debezium working fine the error occurs.

    Description

      After using Debezium as replicator for two days, the following error occurs:

       

      org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42) at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:268) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.IllegalStateException: The update before event at 00028ba5:0000320c:0002(00028ba3:0001e3f4:0001) for table PROTHEUS_PRODUCAO.dbo.SA1010 was not followed by after event. Please report this as a bug together with a events around given LSN. at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.lambda$execute$1(SqlServerStreamingChangeEventSource.java:234) at io.debezium.jdbc.JdbcConnection.prepareQuery(JdbcConnection.java:524) at io.debezium.connector.sqlserver.SqlServerConnection.getChangesForTables(SqlServerConnection.java:190) at io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource.execute(SqlServerStreamingChangeEventSource.java:162) ... 6 more

       

       

      Tried to restart Debezium connector but without success. 

      Running apache Kafka v 2.4.1 with connectDistributed using Debezium as source connector:

       

      Follow the details about source connector:

      connector.class io.debezium.connector.sqlserver.SqlServerConnector
      database.user replicador
      database.dbname PROTHEUS_PRODUCAO
      enable.idempotence true
      tasks.max 1
      database.history.kafka.bootstrap.servers 192.168.240.70:9092,192.168.240.71:9092,192.168.240.72:9092,192.168.240.73:9092,192.168.240.74:9092
      database.history.kafka.topic dbreplication.protheus
      acks all
      transforms route
      database.server.name protheus
      bootstrap.servers 192.168.240.70:9092,192.168.240.71:9092,192.168.240.72:9092,192.168.240.73:9092,192.168.240.74:9092
      database.port 1433
      table.whitelist dbo.SQB010,dbo.AD6010,dbo.ACO010,dbo.ACP010,dbo.ACH010,dbo.ACY010,dbo.CC2010,dbo.CD2010,dbo.CTT010,dbo.DA1010,dbo.DAI010,dbo.DAK010,dbo.SA1010,dbo.SA2010,dbo.SA3010,dbo.SA4010,dbo.SA7010,dbo.SAH010,dbo.SB1010,dbo.SB2010,dbo.SB3010,dbo.SB4010,dbo.SB6010,dbo.SB7010,dbo.SB8010,dbo.SB9010,dbo.SBE010,dbo.SBF010,dbo.SBM010,dbo.SC1010,dbo.SC2010,dbo.SC5010,dbo.SC6010,dbo.SC7010,dbo.SC9010,dbo.SCP010,dbo.SCT010,dbo.SD1010,dbo.SD2010,dbo.SD3010,dbo.SDA010,dbo.SDB010,dbo.SDC010,dbo.SDD010,dbo.SE1010,dbo.SE2010,dbo.SE3010,dbo.SE4010,dbo.SE5010,dbo.SED010,dbo.SF1010,dbo.SF2010,dbo.SF3010,dbo.SF4010,dbo.SF5010,dbo.SG1010,dbo.SJ0010,dbo.SP3010,dbo.SPC010,dbo.SPH010,dbo.SRA010,dbo.SRD010,dbo.SRJ010,dbo.SRV010,dbo.SU5010,dbo.SU7010,dbo.SUA010,dbo.SUB010,dbo.SW0010,dbo.SW1010,dbo.SW2010,dbo.SW3010,dbo.SW4010,dbo.SW5010,dbo.SW6010,dbo.SW7010,dbo.SW8010,dbo.SW9010,dbo.SWA010,dbo.SWB010,dbo.SWD010,dbo.SWP010,dbo.SX5010,dbo.SY4010,dbo.SY6010,dbo.SYA010,dbo.SYB010,dbo.SYD010,dbo.SYE010,dbo.SYP010,dbo.SYQ010,dbo.SZ1010,dbo.SZ2010,dbo.SZ3010,dbo.SZ4010,dbo.SZ9010,dbo.SZB010,dbo.SZC010,dbo.SZI010,dbo.SZJ010,dbo.SZK010,dbo.SZN010,dbo.ZB1010,dbo.ZB2010,dbo.ZB3010,dbo.ZB5010,dbo.ZB6010,dbo.ZP0010,dbo.ZP1010,dbo.ZP2010,dbo.ZP4010,dbo.ZZA010,dbo.ZZC010,dbo.ZZF010,dbo.ZZG010,dbo.ZZH010,dbo.SPED050,dbo.SPED054,dbo.SP9010
      transforms.route.type org.apache.kafka.connect.transforms.RegexRouter
      transforms.route.regex ([^.])\.([^.])\.([^.]+)
      task.class io.debezium.connector.sqlserver.SqlServerConnectorTask
      database.hostname ***
      database.password ***
      name source-protheus
      transforms.route.replacement $3

       

       

       

      Attachments

        Issue Links

          Activity

            People

              jpechane Jiri Pechanec
              wplopes WILLIAM LOPES (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: