Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1532

pgoutput string decoding depends on JVM default charset

    XMLWordPrintable

Details

    Description

      Debezium prescribe using of UTF-8 for database.
      When a string arrives it is decoded by pgoutput decoder in
      io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.readColumnValueAsString(ByteBuffer)
      Unfortunately the coming valus is UTF-* but the conversion is platform specific so if the system is not using UTF-8 as the default one then the string is garbled.

      Workaround - when Kafka Connect is started, set env variable KAFKA_OPTS=-Dfile.encoding=UTF-8 which switches default JVM encoding.

      Attachments

        Activity

          People

            ccranfor@redhat.com Chris Cranford
            jpechane Jiri Pechanec
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: