Uploaded image for project: 'AMQ Broker'
  1. AMQ Broker
  2. ENTMQBR-7891

[LTS] Metrics Plugin Holds References to Destroyed Queue

XMLWordPrintable

      It appears the metrics plugin sometimes holds references to auto-created / auto-deleted queues, resulting in two copies of the queue (same name, same address) in memory, with one marked destroyed. The metrics reports statistics for the destroyed queue, with the result that it reports 0 consumers and no message throughput, triggering alerts.

      Path to GC root for the destroyed queue looks like this:

      Class Name                                                                                                                                              | Referenced Objects | Shallow Heap | Ref. Shallow Heap | Retained Heap
      --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
      org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl$FailureCheckAndFlushThread @ 0x5c9f010f8  activemq-failure-check-thread       |                  1 |          144 |               328 |           592
      |- this$0 org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl @ 0x5f9ec8b00                                                       |                  1 |           96 |               328 |         1,808
      |  |- server org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl @ 0x5c520b730                                                              |                  1 |          256 |               328 |        10,856
      |  |  |- metricsManager org.apache.activemq.artemis.core.server.metrics.MetricsManager @ 0x5eb46cee0                                                    |                  1 |           32 |               328 |        17,496
      |  |  |  |- meters java.util.concurrent.ConcurrentHashMap @ 0x5eb46cf00                                                                                 |                  1 |           64 |               328 |        17,464
      |  |  |  |  |- table java.util.concurrent.ConcurrentHashMap$Node[128] @ 0x5c179a230                                                                     |                  1 |          528 |               328 |        17,400
      |  |  |  |  |  |- [19] java.util.concurrent.ConcurrentHashMap$Node @ 0x60fdbbaf0                                                                        |                  1 |           32 |               328 |           464
      |  |  |  |  |  |  |- val java.util.ArrayList @ 0x60fdbbb68                                                                                              |                  1 |           24 |               328 |           112
      |  |  |  |  |  |  |  |- elementData java.lang.Object[17] @ 0x60fdbbb80                                                                                  |                  1 |           88 |               328 |            88
      |  |  |  |  |  |  |  |  |- [1] io.micrometer.core.instrument.internal.DefaultGauge @ 0x5c243eaa0                                                        |                  1 |           24 |               328 |            72
      |  |  |  |  |  |  |  |  |  |- value org.apache.activemq.artemis.core.server.management.impl.ManagementServiceImpl$$Lambda$88 @ 0x5c243ebe8              |                  1 |           16 |               328 |            16
      |  |  |  |  |  |  |  |  |  |  |- arg$1 org.apache.activemq.artemis.core.server.impl.QueueImpl @ 0x5c36fc6a8                                             |                  1 |          328 |               328 |        45,512
      |  |  |  |  |  |  |  |  |  |  '- Total: 1 entry                                                                                                         |                  1 |          328 |               328 |              
      |  |  |  |  |  |  |  |  |  '- Total: 1 entry                                                                                                            |                  1 |           16 |               328 |              
      |  |  |  |  |  |  |  |  '- Total: 1 entry                                                                                                               |                  1 |           24 |               328 |              
      |  |  |  |  |  |  |  '- Total: 1 entry                                                                                                                  |                  1 |           88 |               328 |              
      |  |  |  |  |  |  '- Total: 1 entry                                                                                                                     |                  1 |           24 |               328 |              
      |  |  |  |  |  '- Total: 1 entry                                                                                                                        |                  1 |           32 |               328 |              
      |  |  |  |  '- Total: 1 entry                                                                                                                           |                  1 |          528 |               328 |              
      |  |  |  '- Total: 1 entry                                                                                                                              |                  1 |           64 |               328 |              
      |  |  '- Total: 1 entry                                                                                                                                 |                  1 |           32 |               328 |              
      |  '- Total: 1 entry                                                                                                                                    |                  1 |          256 |               328 |              
      '- Total: 1 entry                                                                                                                                       |                  1 |           96 |               328 |              
      Total: 1 entry                                                                                                                                          |                  1 |          144 |               328 |              
      --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
      

            rhn-support-jbertram Justin Bertram
            rhn-support-dhawkins Duane Hawkins
            Mikhail Krutov Mikhail Krutov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: