2019-12-11 17:11:01,654 INFO MySQL|shardm|snapshot Step 1: unable to flush and acquire global read lock, will use table read locks after reading table names [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,654 INFO MySQL|shardm|snapshot Step 2: start transaction with consistent snapshot [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,691 INFO MySQL|shardm|snapshot Step 3: read list of available databases [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,729 INFO MySQL|shardm|snapshot list of available databases is: [information_schema, meta, mysql, percona, percona_schema, performance_schema, shopify, sys, test] [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,729 INFO MySQL|shardm|snapshot Step 4: read list of available tables in each database [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.checksum_20151009' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.checksum_2015_11_11' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.checksums' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.checksums_archive' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.gtid_summary' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.health_check' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.heartbeat' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.heartbeat_summary' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:01,806 INFO MySQL|shardm|snapshot 'meta.shops' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] ... 2019-12-11 17:11:02,034 INFO MySQL|shardm|snapshot 'sys.sys_config' is filtered out, discarding [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:02,075 INFO MySQL|shardm|snapshot snapshot continuing with database(s): [shopify] [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:02,112 INFO MySQL|shardm|snapshot Step 5: flush and obtain read lock for 4 tables (preventing writes) [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:12,195 INFO MySQL|shardm|snapshot Step 6: committing transaction [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:12,233 ERROR MySQL|shardm|snapshot Failed due to error: Aborting snapshot due to error when last running 'FLUSH TABLES `shopify`.`app_extension_approval_requests`,`shopify`.`ar_internal_metadata`,`shopify`.`domains`,`shopify`.`schema_migrations` WITH READ LOCK': Lock wait timeout exceeded; try restarting transaction [io.debezium.connector.mysql.SnapshotReader] org.apache.kafka.connect.errors.ConnectException: Lock wait timeout exceeded; try restarting transaction Error code: 1205; SQLSTATE: 40001. at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:208) at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:721) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.mysql.cj.jdbc.exceptions.MySQLTransactionRollbackException: Lock wait timeout exceeded; try restarting transaction at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:123) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:782) at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666) at io.debezium.jdbc.JdbcConnection.executeWithoutCommitting(JdbcConnection.java:1121) at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:361) ... 3 more 2019-12-11 17:11:12,294 INFO || WorkerSourceTask{id=m-0} Committing offsets [org.apache.kafka.connect.runtime.WorkerSourceTask] 2019-12-11 17:11:12,294 INFO || WorkerSourceTask{id=m-0} flushing 0 outstanding messages for offset commit [org.apache.kafka.connect.runtime.WorkerSourceTask] 2019-12-11 17:11:12,294 ERROR || WorkerSourceTask{id=m-0} Task threw an uncaught and unrecoverable exception [org.apache.kafka.connect.runtime.WorkerTask] org.apache.kafka.connect.errors.ConnectException: Lock wait timeout exceeded; try restarting transaction Error code: 1205; SQLSTATE: 40001. at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230) at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:208) at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:721) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.mysql.cj.jdbc.exceptions.MySQLTransactionRollbackException: Lock wait timeout exceeded; try restarting transaction at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:123) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:782) at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666) at io.debezium.jdbc.JdbcConnection.executeWithoutCommitting(JdbcConnection.java:1121) at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:361) ... 3 more 2019-12-11 17:11:12,294 ERROR || WorkerSourceTask{id=m-0} Task is being killed and will not recover until manually restarted [org.apache.kafka.connect.runtime.WorkerTask] 2019-12-11 17:11:12,294 INFO MySQL|shardm|task Stopping MySQL connector task [io.debezium.connector.mysql.MySqlConnectorTask] 2019-12-11 17:11:12,294 INFO MySQL|shardm|task ChainedReader: Stopping the snapshot reader [io.debezium.connector.mysql.ChainedReader] 2019-12-11 17:11:12,294 INFO MySQL|shardm|task Discarding 0 unsent record(s) due to the connector shutting down [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:12,294 INFO MySQL|shardm|task Discarding 0 unsent record(s) due to the connector shutting down [io.debezium.connector.mysql.SnapshotReader] 2019-12-11 17:11:12,295 INFO MySQL|shardm|task [Producer clientId=m-dbhistory] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. [org.apache.kafka.clients.producer.KafkaProducer] 2019-12-11 17:11:12,296 INFO MySQL|shardm|task Connector task finished all work and is now shutdown [io.debezium.connector.mysql.MySqlConnectorTask] 2019-12-11 17:11:12,296 INFO || [Producer clientId=producer-37] Closing the Kafka producer with timeoutMillis = 30000 ms. [org.apache.kafka.clients.producer.KafkaProducer]