Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2495

Gracefully handle server-side filtered columns

    XMLWordPrintable

Details

    Description

      As of DBZ-1068, the SQL Server connector supports partial capture instances now, i.e. specific columns can already be excluded in the database / capture instance itself.

      Right now, those columns must also be excluded via column.exclude.list in the connector though, so to avoid an exception due to misaligned schemas (see SqlServerConnectorIT.excludeColumnWhenCaptureInstanceExcludesColumns() for the error by removing the filter onfiguration there).

      Once done, remove this comment from the connector docs:

      When calling `sys.sp_cdc_enable_table()` with the `captured_column_list` parameter for capturing only a subset of a table's columns,
      the connector's

      Unknown macro: {link-prefix}

      :

      Unknown macro: {link-sqlserver-connector}

      #sqlserver-property-column-exclude-list[column.exclude.list] configuration property must be set accordingly, excluding all non-captured columns.

      Also the comment in PR #748 needs addressing, which deals with a corner case around renamed columns.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              gunnar.morling Gunnar Morling
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: