Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2511

Debezium logs "is not a valid Avro schema name" can be too verbose

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 1.5.0.CR1
    • 1.2.1.Final
    • mysql-connector
    • None

    Description

      We get thousands of warnings like this one in our Kafka Connect logs:

      The Kafka Connect schema name 'server-name-with-dashes.some_table.Value' is not a valid Avro schema name, so replacing with 'server_name_with_dashes.sometable.Value'

      It's not an expected behavior as:

      • We don't use AVRO converters. Our settings
      "key.converter": "org.apache.kafka.connect.json.JsonConverter",
       "key.converter.schemas.enable": "false",
       "value.converter": "org.apache.kafka.connect.json.JsonConverter",
       "value.converter.schemas.enable": "true",
      • The amount of these messages is so big that it breaks the daemon collecting logs in our environment. 

      We use 1 debezium connector per aurora cluster. That cluster can be big enough - 500+ databases with 200+ tables each.

      Attachments

        Activity

          People

            jpechane Jiri Pechanec
            mikekamornikov Mikhail Kamornikau
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: