Type: Feature Request
Status: Open (View Workflow)
Affects Version/s: 0.9.0.Beta2
Fix Version/s: None
- Debezium 0.9.0Beta2
- wal2json commit d4c0e814696695bbf853c48b38b7479e0f83f6c7
- Postgresql 11.1
- confluent platform 5.1
- zookeeper 3.4.13
Debezium Postgresql connector does not support arbitrary-dimensional array. For example,
In case of two-dimensional array of INT
Postgresql connector warns it and the result value is null.
In case of two-dimensional array of TEXT
Postgresql connector does not warn as follow and the result value seems to be casted string.
- Warning should be logged.
At least, as long as Debezium does not support arbitrary-dimensional array, warning should be logged when it finds a two or more dimensional array of any data type. Moreover, if "include.unknown.datatypes" is enabled, raw binary representation of a column should be set as the result.
- Support arbitrary-dimensional array
I guess the reason why Debezium does not support it is that both avro and protobuf can not define an arbitrary-dimensional array schema.
My suggestion is to define such array schema as a linear(flatten) array with the dimension infomation.