Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1076

Postgresql ARRAY support

    Details

    • Type: Feature Request
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.0.Beta2
    • Fix Version/s: None
    • Component/s: postgresql-connector
    • Labels:
    • Environment:
      • Debezium 0.9.0Beta2
      • wal2json commit d4c0e814696695bbf853c48b38b7479e0f83f6c7
      • Postgresql 11.1
      • confluent platform 5.1
      • zookeeper 3.4.13

      Description

      Zebezium does not support many array types even in case of one-dimensional array.

      Array types completely disappeared from event message

      Debezium has no converter for the following array types even in case of one-dimensional array. That is, Avro schema has no fieild for these column types. Result message has no field for these column types.

      BYTEA[], TIMESTAMP[], TIMESTAMPTZ[], TIME[], TIMETZ[], INTERVAL[], POINT[], VARBIT[], UUID[], XML[], JSON[], JSONB[]

      Example Warning message

      [l.TableSchemaBuilder] No converter found for column common_0.tbl_2.c_arr_uuid of type _uuid. The column will not be part of change events for that table.
      

      Array types converted to null

      Debezium can not parse the following array type values and set *null*s as results even in case of one-dimensional array and "include.unknown.datatypes=true".

      BIT[], ENUM[], LINE[], LSEG[], BOX[], PATH[], POLYGON[], CIRCLE[], CIDR[], INET[], MACADDR[], MACADDR8[], INT4RANGE[], INT8RANGE[], NUMRANGE[], TSRANGE[], TSTZRANGE[], DATERANGE[]

      Example Warning message

      [stgresValueConverter] Unexpected JDBC BINARY value for field c_arr_bit_1 with schema Schema{BOOLEAN}: class=class java.util.Arrays$ArrayList, value=[true]
      

      Request

      If "include.unknown.datatypes" is enabled, raw binary representation of a column should be set as the result when Debezium can not parse it.

      In conclusion, Debezium should support these array types (at least, array of currently supported types).

        Gliffy Diagrams

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  takaomag Takao Magoori
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated: