Uploaded image for project: 'JBoss A-MQ'
  1. JBoss A-MQ
  2. ENTMQ-2195

Missing or Stuck Network Queue Consumers in Network of Brokers with conduitSubscriptions Disabled

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • JBoss A-MQ 6.3.x
    • JBoss A-MQ 6.3
    • broker, networks
    • None
    • +
    • Hide

      We have been able to intermittently reproduce this by starting a 3-broker NOB and bringing up and down large numbers of consumers, waiting for them to balance and we see that the consumer counts on the queue vary from broker to broker even after the broker has had some time to settle.

      Working on a more consistent reproducer.

      Show
      We have been able to intermittently reproduce this by starting a 3-broker NOB and bringing up and down large numbers of consumers, waiting for them to balance and we see that the consumer counts on the queue vary from broker to broker even after the broker has had some time to settle. Working on a more consistent reproducer.

      In a network of brokers configured for balancing, similar to the attached configuration, when local consumers are added or removed, the network subscription count is not consistently reflected. It appears that both new and delete subscription advisories are sometimes either missed or suppressed with the result that not all live consumers get a remote consumer on the bridge and when all local consumers are shut down (no local consumers on any broker in the NOB), we still see consumers on the bridge, resulting in forwarding behavior when no actual demand exists on the other side of the bridge.

      This is occurring with no pendingMessageLimitStrategy applied. It seems to occur more frequently if suppressDuplicateQueueSubscriptions=true, but has been observed to occur without this flag set, as well.

        1. amq1logs120stuckconsumers.tar.gz
          269 kB
          Duane Hawkins
        2. amq1-log-stuck-NOB-consumer.tar.gz
          223 kB
          Duane Hawkins
        3. amq3logs120stuckconsumers.tar.gz
          139 kB
          Duane Hawkins
        4. amq3-log-stuck-NOB-consumer.tar.gz
          343 kB
          Duane Hawkins
        5. amq5logs120stuckconsumers.tar.gz
          137 kB
          Duane Hawkins
        6. ClientRebalanceAdvisoryTest.java
          6 kB
          Gary Tully
        7. ENTMQ-2195.diff
          30 kB
          Gary Tully
        8. logs-reproducer-no-suppress-amq1.tar.gz
          7.82 MB
          Duane Hawkins
        9. logs-reproducer-no-suppress-amq3.tar.gz
          7.70 MB
          Duane Hawkins
        10. logs-reproducer-no-suppress-amq5.tar.gz
          3.25 MB
          Duane Hawkins
        11. reproducer.xml
          6 kB
          Duane Hawkins
        12. stuck-consumers.txt
          30 kB
          Duane Hawkins
        13. stuckconsumers2nodesamq1.tar.gz
          2.35 MB
          Duane Hawkins
        14. stuckconsumers2nodesamq3.tar.gz
          74 kB
          Duane Hawkins
        15. stuckconsumers2nodesamq5.tar.gz
          2.34 MB
          Duane Hawkins
        16. threaded-mq-fabric-client.tar.gz
          26 kB
          Duane Hawkins

            gtully@redhat.com Gary Tully
            rhn-support-dhawkins Duane Hawkins
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: