Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2283

Adjust snapshot SELECTs to exclude filtered columns

XMLWordPrintable

      Debezium connectors allow to exclude specific table columns from change events, e.g. to exclude large BLOB columns or columns with sensitive data.

      That's controlled via the column.blacklist option (soon to be renamed, see DBZ-2171). Currently those excluded columns are excluded by the Debezium engine (see usages of Filters#columnFilter()), but for the sake of efficiency, we should not select their value(s) to begin with during snapshotting. The default snapshot SELECT produced for each table (see RelationalSnapshotChangeEventSource#getSnapshotSelect()) should therefore be adjusted to only select the non-excluded columns.

      If a specific SELECT statement is given (see the snapshot.select.statement.overrides option), this one should take precedence.

            ccranfor@redhat.com Chris Cranford
            gunnar.morling Gunnar Morling
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: