Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-892

Connector Postgres runs out of disk space

    XMLWordPrintable

Details

    Description

      After deploying the Debezium connector for Postgres in our unstable environment we faced our Postgres instance quickly running out of space.

      We have a Postgres instance where we have two databases: production and unstable.

      The connector is configured to capture changes from the unstable database. The changes on unstable are few and the connector works correctly.
      However, the traffic on the production database is quite high and we noticed that the disk space increases monotonically until we almost ran out of disk space.

      After stopping the connector and deleting the replication slot, the disk space was freed up.
      It appears to me that `replication_slots` in Postgres work across databases and the Connector is not listening to the event of other databases.

      Attachments

        1. debezium.png
          42 kB
          Bogdan Ionescu
        2. free.jpg
          65 kB
          Bogdan Ionescu
        3. heartbeat.jpg
          50 kB
          Bogdan Ionescu
        4. leak.JPG
          60 kB
          Bogdan Ionescu
        5. Screen Shot 2018-09-03 at 09.58.53.png
          130 kB
          Andrii Bratus
        6. Screenshot 2018-12-11 at 10.44.35.png
          41 kB
          Andrii Bratus
        7. Screenshot 2018-12-11 at 10.44.54.png
          40 kB
          Andrii Bratus
        8. Transaction Logs Usage.png
          190 kB
          Hayman Yu

        Issue Links

          Activity

            People

              jpechane Jiri Pechanec
              andreybratus Andrii Bratus (Inactive)
              Votes:
              7 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: