Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1214

Postgres Connector times out in schema discovery for DBs with many tables

    XMLWordPrintable

    Details

      Description

      When doing the initial schema discovery for a database with 1000+ tables, the postgres replication connection times out.

      This happens because we create the replication connection and then do all the work to get catalog information. If this process takes more than a minute, then the postgres backend kills the replication connection due to a timeout.

      The jdbc API relies on us to either call `read` or to `forceStatusUpdate` in order to have the statusUpdateInterval to cause a keep alive message to be sent to the server.

      I have a potential fix for this that relies on creating a temporary background thread

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                addisonj Addison Higham
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: