Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-827

Schema only recovery makes connector skip binlog files

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Major
    • None
    • 0.7.2
    • mysql-connector
    • None

    Description

      1. Binlog source connector task config

      {
          "name": "binlog-mobp2p.yyd_users_log-4",
          "connector.class": "io.debezium.connector.mysql.MySqlConnector",
          "database.hostname": "main.slave.db.ql.corp",
          "database.port": "33944",
          "database.user": "***",
          "database.password": "*****",
          "database.history.kafka.bootstrap.servers": "msgmgt-kafka.01.service.prod.uc:9092,msgmgt-kafka.02.service.prod.uc:9092,msgmgt-kafka.03.service.prod.uc:9092",
          "database.history.kafka.topic": "mobp2p.yyd_users_log.history",
          "database.server.name": "main.slave.yyd_users_log",
          "database.whitelist": "mobp2p",
          "table.whitelist": "mobp2p.yyd_users_log"
      }
      

      2. Task can't write new binlog messages into kafka, after running schema_only_recovery the task got fixed with data lost.

      3. Bellow is connect-offsets messsage for the task. What under the red line are produced after running schema_only_recovery

      screenshot

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            artiship artiship artiship (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: