-
Bug
-
Resolution: Cannot Reproduce
-
Major
-
None
-
0.10.0.Final
-
None
I have two kafka connectors running in distributed mode controlled by a strimzi operator. Each of these connectors is streaming a separate table from the same mysql-5.6 database.
This has happened in two separate scenarios. The first time it happened I had just upgraded the debezium plugin from 0.9.2 to 0.10.0.Final. The connector came up using the upgraded plugin and showed itself to be in a RUNNING state when I queried the `/connectors/<connector name>/tasks/0/status` endpoint. If I tried tailing the topic from the broker, however, there were no new events being published. I had to force the connector to take a new snapshot for it to recover. The second time it happened, I upgraded the strimzi operator from 0.13.0 to 0.14.0. The connector reacted in a very similar way in that the tasks endpoint showed it to be running but there were no new events coming from the tables.
In both scenarios there was a brief interruption in the availability of the broker which I'm guessing is what caused the connectors to freeze.
I have the cluster and connectors in this state still so I will try and include as much of the logging and endpoint info as I can.
curl platform-connect-api:8083/connectors/database-sell-item | jq { "name": "database-sell-item", "config": { "connector.class": "io.debezium.connector.mysql.MySqlConnector", "database.user": "debezium", "database.server.id": "1801", "tasks.max": "1", "database.history.kafka.bootstrap.servers": "platform-kafka-bootstrap:9092", "database.history.kafka.topic": "sell-item", "database.server.name": "database", "database.port": "3306", "table.whitelist": "database.sell_item", "value.converter.schema.registry.url": "http://avro-registry:8081", "database.hostname": "debezium-mysql.database-mysql", "database.password": "xxxxxxxxxxxx", "name": "database-sell-item", "value.converter": "io.confluent.connect.avro.AvroConverter", "database.whitelist": "database", "key.converter": "io.confluent.connect.avro.AvroConverter", "key.converter.schema.registry.url": "http://avro-registry:8081", "snapshot.mode": "when_needed" }, "tasks": [ { "connector": "database-sell-item", "task": 0 } ], "type": "source" }
curl platform-connect-api:8083/connectors/database-sell-item/tasks/0/status | jq { "id": 0, "state": "RUNNING", "worker_id": "10.20.15.17:8083" }