Uploaded image for project: 'A-MQ Broker'
  1. A-MQ Broker
  2. ENTMQBR-130

Broker freezes if I run it against PerfTest.exe from amqpnetlite client

    Details

    • Type: Bug
    • Status: Done
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: A-MQ 7.0.0.ER9
    • Fix Version/s: A-MQ 7.0.0.ER14
    • Component/s: None
    • Labels:
      None
    • Environment:

      Mono JIT compiler version 4.4.1 (Nightly 4.4.1.0/4747417 Fri Jul 22 07:49:26 UTC 2016)

      Description

      I checked out the amqpnetlite upstream source, compiled it in MonoDevelop on Linux (some subprojects did not compile, but PerfTest did) and ran PerfTest against ER9 broker.

      [Azure/amqpnetlite.git]$ mono bin/Debug/PerfTest/PerfTest.exe send -n jms.queue.q1
      Running perf test...
      [11:02:53.419] completed 1000 throughput -1 msg/s
      [11:02:53.726] completed 2000 throughput 6514 msg/s
      [11:02:53.806] completed 3000 throughput 7751 msg/s
      [11:02:53.884] completed 4000 throughput 8602 msg/s
      [11:02:53.941] completed 5000 throughput 9560 msg/s
      [11:02:53.993] completed 6000 throughput 10452 msg/s
      [11:02:54.033] completed 7000 throughput 11382 msg/s
      [11:02:54.072] completed 8000 throughput 12251 msg/s
      [11:02:54.112] completed 9000 throughput 12987 msg/s
      ^C
      
      [Azure/amqpnetlite.git]$ mono bin/Debug/PerfTest/PerfTest.exe receive -n jms.queue.q1    
      Running perf test...
      [11:03:00.838] completed 1000 throughput -1 msg/s
      [11:03:01.016] completed 2000 throughput 11235 msg/s
      [11:03:01.114] completed 3000 throughput 10909 msg/s
      [11:03:01.212] completed 4000 throughput 10695 msg/s
      [11:03:01.282] completed 5000 throughput 11261 msg/s
      [11:03:01.369] completed 6000 throughput 11299 msg/s
      [11:03:01.464] completed 7000 throughput 11182 msg/s
      [11:03:01.588] completed 8000 throughput 10666 msg/s
      [11:03:01.717] completed 9000 throughput 10238 msg/s
      ^C
      
      [Azure/amqpnetlite.git]$ mono bin/Debug/PerfTest/PerfTest.exe send -n jms.queue.q1 -c 30
      Running perf test...
      ^C
      
      [Azure/amqpnetlite.git]$ mono bin/Debug/PerfTest/PerfTest.exe receive -n jms.queue.q1 -c 30
      Running perf test...
      [11:03:23.045] Exception occurred: System.NullReferenceException: Object reference not set to an instance of an object
        at PerfTest.Program+Role.OnComplete () <0x41b52cc0 + 0x00157> in <filename unknown>:0 
        at PerfTest.Program+Receiver.<RunOnce>m__1 (Amqp.ReceiverLink r, Amqp.Message m) <0x41b52820 + 0x0003f> in <filename unknown>:0 
        at Amqp.ReceiverLink.OnTransfer (Amqp.Delivery delivery, Amqp.Framing.Transfer transfer, Amqp.ByteBuffer buffer) <0x41b50f50 + 0x0086f> in <filename unknown>:0 
        at Amqp.Session.OnTransfer (Amqp.Framing.Transfer transfer, Amqp.ByteBuffer buffer) <0x41b50160 + 0x00524> in <filename unknown>:0 
        at Amqp.Session.OnCommand (Amqp.Types.DescribedList command, Amqp.ByteBuffer buffer) <0x41b46580 + 0x001b3> in <filename unknown>:0 
        at Amqp.Connection.OnSessionCommand (UInt16 remoteChannel, Amqp.Types.DescribedList command, Amqp.ByteBuffer buffer) <0x41b46520 + 0x00043> in <filename unknown>:0 
        at Amqp.Connection.OnFrame (Amqp.ByteBuffer buffer) <0x41b3bf30 + 0x0031f> in <filename unknown>:0 
      ^C
      [Azure/amqpnetlite.git]$
      

      The broker froze and I had to SIGKILL it.

      [jdanek@nixos:~/Work]$ amq7er9-i0/bin/artemis run |& tee broker.log
           _        _               _
          / \  ____| |_  ___ __  __(_) _____
         / _ \|  _ \ __|/ _ \  \/  | |/  __/
        / ___ \ | \/ |_/  __/ |\/| | |\___ \
       /_/   \_\|   \__\____|_|  |_|_|/___ /
       Apache ActiveMQ Artemis 1.3.0.amq-700002-redhat-1
      
      
      11:02:34,883 INFO  [org.apache.activemq.artemis.integration.bootstrap] AMQ101000: Starting ActiveMQ Artemis Server
      11:02:34,899 INFO  [org.apache.activemq.artemis.core.server] AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=false,journalDirectory=./data/journal,bindingsDirectory=./data/bindings,largeMessagesDirectory=./data/large-messages,pagingDirectory=./data/paging)
      11:02:34,943 INFO  [org.apache.activemq.artemis.core.server] AMQ221013: Using NIO Journal
      11:02:35,008 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE
      11:02:35,011 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP
      11:02:35,013 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ
      11:02:35,014 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-mqtt-protocol]. Adding protocol support for: MQTT
      11:02:35,015 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-openwire-protocol]. Adding protocol support for: OPENWIRE
      11:02:35,016 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP
      11:02:35,891 INFO  [org.apache.activemq.artemis.core.server] AMQ221003: Trying to deploy queue jms.queue.DLQ
      11:02:35,900 INFO  [org.apache.activemq.artemis.core.server] AMQ221003: Trying to deploy queue jms.queue.ExpiryQueue
      11:02:36,378 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:61616 for protocols [CORE,MQTT,AMQP,HORNETQ,STOMP,OPENWIRE]
      11:02:36,381 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:5445 for protocols [HORNETQ,STOMP]
      11:02:36,383 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:5672 for protocols [AMQP]
      11:02:36,385 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:1883 for protocols [MQTT]
      11:02:36,391 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:61613 for protocols [STOMP]
      11:02:36,391 INFO  [org.apache.activemq.artemis.core.server] AMQ221007: Server is now live
      11:02:36,391 INFO  [org.apache.activemq.artemis.core.server] AMQ221001: Apache ActiveMQ Artemis Message Broker version 1.3.0.amq-700002-redhat-1 [0.0.0.0, nodeID=b53b5d1b-692d-11e6-a25c-0a0027000001] 
      SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
      SLF4J: Defaulting to no-operation (NOP) logger implementation
      SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
      INFO  | main | Initialized artemis-plugin plugin
      INFO  | main | Initialized dispatch-hawtio-console plugin
      11:02:37,793 INFO  [org.apache.activemq.artemis] AMQ241001: HTTP Server started at http://localhost:8161
      11:02:37,794 INFO  [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia REST API available at http://localhost:8161/jolokia
      11:02:54,155 WARN  [org.apache.activemq.artemis.core.server] AMQ222183: Blocking message production on address 'jms.queue.q1'; size is currently: 10,486,800 bytes; max-size-bytes: 10,485,760
      11:02:55,935 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      11:02:55,936 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session 5e681e8b-6dc7-11e6-a54c-f6b8dc37beaa
      11:02:55,937 WARN  [org.apache.activemq.artemis.core.server] AMQ222107: Cleared up resources for session 5e681e8b-6dc7-11e6-a54c-f6b8dc37beaa
      11:03:05,082 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      11:03:05,082 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session 62c8e09c-6dc7-11e6-a54c-f6b8dc37beaa
      11:03:05,125 WARN  [org.apache.activemq.artemis.core.server] AMQ222107: Cleared up resources for session 62c8e09c-6dc7-11e6-a54c-f6b8dc37beaa
      11:03:17,473 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      11:03:17,474 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session 6a71efdd-6dc7-11e6-a54c-f6b8dc37beaa
      11:03:17,474 WARN  [org.apache.activemq.artemis.core.server] AMQ222107: Cleared up resources for session 6a71efdd-6dc7-11e6-a54c-f6b8dc37beaa
      ^C^C^C
      
      
      ^C
      
      
      ^C
      
      
      ^C
      
      ^C
      

      I tried waiting for over 10 minutes and it never quit on its own after just a SIGTERM.

      This issue cannot be reproduced every time. Usually, the broker just freezes, but once it printed a threaddump before it froze:

      amq7er9-i0/bin/artemis run
           _        _               _
          / \  ____| |_  ___ __  __(_) _____
         / _ \|  _ \ __|/ _ \  \/  | |/  __/
        / ___ \ | \/ |_/  __/ |\/| | |\___ \
       /_/   \_\|   \__\____|_|  |_|_|/___ /
       Apache ActiveMQ Artemis 1.3.0.amq-700002-redhat-1
      
      
      23:26:52,708 INFO  [org.apache.activemq.artemis.integration.bootstrap] AMQ101000: Starting ActiveMQ Artemis Server
      23:26:52,729 INFO  [org.apache.activemq.artemis.core.server] AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=false,journalDirectory=./data/journal,bindingsDirectory=./data/bindings,largeMessagesDirectory=./data/large-messages,pagingDirectory=./data/paging)
      23:26:52,771 INFO  [org.apache.activemq.artemis.core.server] AMQ221013: Using NIO Journal
      23:26:52,826 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE
      23:26:52,828 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP
      23:26:52,830 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ
      23:26:52,833 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-mqtt-protocol]. Adding protocol support for: MQTT
      23:26:52,834 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-openwire-protocol]. Adding protocol support for: OPENWIRE
      23:26:52,837 INFO  [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP
      23:26:53,618 INFO  [org.apache.activemq.artemis.core.server] AMQ221003: Trying to deploy queue jms.queue.DLQ
      23:26:53,630 INFO  [org.apache.activemq.artemis.core.server] AMQ221003: Trying to deploy queue jms.queue.ExpiryQueue
      23:26:55,587 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:61616 for protocols [CORE,MQTT,AMQP,HORNETQ,STOMP,OPENWIRE]
      23:26:55,645 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:5445 for protocols [HORNETQ,STOMP]
      23:26:55,650 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:5672 for protocols [AMQP]
      23:26:55,652 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:1883 for protocols [MQTT]
      23:26:55,659 INFO  [org.apache.activemq.artemis.core.server] AMQ221020: Started Acceptor at 0.0.0.0:61613 for protocols [STOMP]
      23:26:55,659 INFO  [org.apache.activemq.artemis.core.server] AMQ221007: Server is now live
      23:26:55,659 INFO  [org.apache.activemq.artemis.core.server] AMQ221001: Apache ActiveMQ Artemis Message Broker version 1.3.0.amq-700002-redhat-1 [0.0.0.0, nodeID=b53b5d1b-692d-11e6-a25c-0a0027000001] 
      SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
      SLF4J: Defaulting to no-operation (NOP) logger implementation
      SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
      INFO  | main | Initialized artemis-plugin plugin
      INFO  | main | Initialized dispatch-hawtio-console plugin
      23:26:57,637 INFO  [org.apache.activemq.artemis] AMQ241001: HTTP Server started at http://localhost:8161
      23:26:57,638 INFO  [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia REST API available at http://localhost:8161/jolokia
      23:26:59,023 WARN  [org.apache.activemq.artemis.core.server] AMQ222183: Blocking message production on address 'jms.queue.q1'; size is currently: 10,486,800 bytes; max-size-bytes: 10,485,760
      23:27:01,607 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      23:27:01,608 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session d19d307a-6bd3-11e6-85be-f6b8dc37beaa
      23:27:01,608 WARN  [org.apache.activemq.artemis.core.server] AMQ222107: Cleared up resources for session d19d307a-6bd3-11e6-85be-f6b8dc37beaa
      23:27:30,251 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      23:27:30,251 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session d7021c1b-6bd3-11e6-85be-f6b8dc37beaa
      23:27:30,299 WARN  [org.apache.activemq.artemis.core.server] AMQ222107: Cleared up resources for session d7021c1b-6bd3-11e6-85be-f6b8dc37beaa
      ^CINFO  | Thread-2 | Destroyed dispatch-hawtio-console plugin
      INFO  | Thread-2 | Destroyed artemis-plugin plugin
      ^[[A
      23:28:06,066 WARN  [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: null [code=REMOTE_DISCONNECT]
      23:28:06,066 WARN  [org.apache.activemq.artemis.core.server] AMQ222061: Client connection failed, clearing up resources for session e8d5b55c-6bd3-11e6-85be-f6b8dc37beaa
      23:28:07,072 WARN  [org.apache.activemq.artemis.core.server] AMQ222109: Timed out waiting for write lock on consumer. Check the Thread dump
      23:28:07,082 WARN  [org.apache.activemq.artemis.core.server] AMQ222199: Thread dump: AMQ119001: Generating thread dump
      *******************************************************************************
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (ActiveMQ-Asynchronous-Persistent-Writes952486988-932285561),5,ActiveMQ-Asynchronous-Persistent-Writes952486988-932285561] name = Thread-0 (ActiveMQ-Asynchronous-Persistent-Writes952486988-932285561) id = 17 group = java.lang.ThreadGroup[name=ActiveMQ-Asynchronous-Persistent-Writes952486988-932285561,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (activemq-netty-threads-1537471098),5,activemq-netty-threads-1537471098] name = Thread-0 (activemq-netty-threads-1537471098) id = 52 group = java.lang.ThreadGroup[name=activemq-netty-threads-1537471098,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-12 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-12 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 111 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[activemq-buffer-timeout,5,main] name = activemq-buffer-timeout id = 12 group = java.lang.ThreadGroup[name=main,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
      java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
      java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
      java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
      org.apache.activemq.artemis.core.io.buffer.TimedBuffer$CheckTimer.run(TimedBuffer.java:395)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-7 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-7 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 106 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (activemq-netty-threads-35534346),5,activemq-netty-threads-35534346] name = Thread-0 (activemq-netty-threads-35534346) id = 40 group = java.lang.ThreadGroup[name=activemq-netty-threads-35534346,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-22 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-22 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 121 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-10 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-10 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 109 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      org.proton.plug.context.AbstractProtonContextSender.performSend(AbstractProtonContextSender.java:129)
      org.proton.plug.context.server.ProtonServerSenderContext.deliverMessage(ProtonServerSenderContext.java:396)
      org.apache.activemq.artemis.core.protocol.proton.plug.ProtonSessionIntegrationCallback.sendMessage(ProtonSessionIntegrationCallback.java:489)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.deliverStandardMessage(ServerConsumerImpl.java:1043)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.proceedDeliver(ServerConsumerImpl.java:417)
      org.apache.activemq.artemis.core.server.impl.QueueImpl.proceedDeliver(QueueImpl.java:2504)
      org.apache.activemq.artemis.core.server.impl.QueueImpl.deliver(QueueImpl.java:1996)
      org.apache.activemq.artemis.core.server.impl.QueueImpl.access$1500(QueueImpl.java:99)
      org.apache.activemq.artemis.core.server.impl.QueueImpl$DeliverRunner.run(QueueImpl.java:2745)
      org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:103)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (activemq-netty-threads-122114483),5,activemq-netty-threads-122114483] name = Thread-0 (activemq-netty-threads-122114483) id = 76 group = java.lang.ThreadGroup[name=activemq-netty-threads-122114483,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-15 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-15 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 114 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-9 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-9 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 108 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-5 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-5 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 23 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.cancelRefs(ServerConsumerImpl.java:581)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.cancelRefs(ServerConsumerImpl.java:68)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.doRollback(ServerSessionImpl.java:1533)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.rollback(ServerSessionImpl.java:765)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.rollback(ServerSessionImpl.java:749)
      org.apache.activemq.artemis.core.protocol.proton.plug.ProtonSessionIntegrationCallback.rollbackCurrentTX(ProtonSessionIntegrationCallback.java:312)
      org.proton.plug.context.AbstractProtonSessionContext.close(AbstractProtonSessionContext.java:143)
      org.proton.plug.context.AbstractConnectionContext$LocalListener.onRemoteClose(AbstractConnectionContext.java:229)
      org.proton.plug.handler.Events.dispatch(Events.java:46)
      org.proton.plug.handler.impl.ProtonHandlerImpl.dispatch(ProtonHandlerImpl.java:364)
      org.proton.plug.handler.impl.ProtonHandlerImpl.access$000(ProtonHandlerImpl.java:49)
      org.proton.plug.handler.impl.ProtonHandlerImpl$1.run(ProtonHandlerImpl.java:64)
      org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:103)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-27 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-27 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 126 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-2 (ActiveMQ-scheduled-threads-1089504328),5,ActiveMQ-scheduled-threads-1089504328] name = Thread-2 (ActiveMQ-scheduled-threads-1089504328) id = 25 group = java.lang.ThreadGroup[name=ActiveMQ-scheduled-threads-1089504328,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-0 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 18 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[activemq-expiry-reaper-thread,3,main] name = activemq-expiry-reaper-thread id = 27 group = java.lang.ThreadGroup[name=main,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
      java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
      java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
      java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
      org.apache.activemq.artemis.core.postoffice.impl.PostOfficeImpl$Reaper.run(PostOfficeImpl.java:1286)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-1 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-1 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 19 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Reference Handler,10,system] name = Reference Handler id = 2 group = java.lang.ThreadGroup[name=system,maxpri=10]
      
      java.lang.Object.wait(Native Method)
      java.lang.Object.wait(Object.java:502)
      java.lang.ref.Reference.tryHandlePending(Reference.java:191)
      java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-16 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-16 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 115 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-1 (activemq-netty-threads-1537471098),5,activemq-netty-threads-1537471098] name = Thread-1 (activemq-netty-threads-1537471098) id = 53 group = java.lang.ThreadGroup[name=activemq-netty-threads-1537471098,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[DestroyJavaVM,5,main] name = DestroyJavaVM id = 103 group = java.lang.ThreadGroup[name=main,maxpri=10]
      
      ===============================================================================
      AMQ119002: Thread Thread[Thread-21 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-21 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 120 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-13 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-13 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 112 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-6 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-6 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 104 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-8 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-8 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 107 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Signal Dispatcher,9,system] name = Signal Dispatcher id = 4 group = java.lang.ThreadGroup[name=system,maxpri=10]
      
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (ActiveMQ-scheduled-threads-1089504328),5,ActiveMQ-scheduled-threads-1089504328] name = Thread-0 (ActiveMQ-scheduled-threads-1089504328) id = 13 group = java.lang.ThreadGroup[name=ActiveMQ-scheduled-threads-1089504328,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-29 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-29 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 128 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-11 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-11 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 110 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[threadDeathWatcher-2-1,1,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = threadDeathWatcher-2-1 id = 105 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      java.lang.Thread.sleep(Native Method)
      io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:147)
      io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:145)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-2,5,main] name = Thread-2 id = 11 group = java.lang.ThreadGroup[name=main,maxpri=10]
      
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.doClose(ServerSessionImpl.java:331)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl$1.done(ServerSessionImpl.java:1173)
      org.apache.activemq.artemis.core.persistence.impl.journal.OperationContextImpl.executeOnCompletion(OperationContextImpl.java:186)
      org.apache.activemq.artemis.core.persistence.impl.journal.OperationContextImpl.executeOnCompletion(OperationContextImpl.java:131)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.close(ServerSessionImpl.java:1165)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.connectionFailed(ServerSessionImpl.java:1463)
      org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.connectionFailed(ServerSessionImpl.java:1474)
      org.apache.activemq.artemis.spi.core.protocol.AbstractRemotingConnection.callFailureListeners(AbstractRemotingConnection.java:67)
      org.apache.activemq.artemis.core.protocol.proton.ActiveMQProtonRemotingConnection.fail(ActiveMQProtonRemotingConnection.java:70)
      org.apache.activemq.artemis.spi.core.protocol.AbstractRemotingConnection.fail(AbstractRemotingConnection.java:214)
      org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl.connectionDestroyed(RemotingServiceImpl.java:541)
      org.apache.activemq.artemis.core.remoting.impl.netty.NettyAcceptor$Listener.connectionDestroyed(NettyAcceptor.java:676)
      org.apache.activemq.artemis.core.remoting.impl.netty.NettyConnection.close(NettyConnection.java:211)
      org.apache.activemq.artemis.core.protocol.proton.ActiveMQProtonRemotingConnection.disconnect(ActiveMQProtonRemotingConnection.java:113)
      org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl.freeze(RemotingServiceImpl.java:355)
      org.apache.activemq.artemis.core.server.impl.LiveOnlyActivation.freezeConnections(LiveOnlyActivation.java:99)
      org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.freezeConnections(ActiveMQServerImpl.java:958)
      org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.stop(ActiveMQServerImpl.java:778)
      org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.stop(ActiveMQServerImpl.java:690)
      org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.stop(ActiveMQServerImpl.java:582)
      org.apache.activemq.artemis.jms.server.impl.JMSServerManagerImpl.stop(JMSServerManagerImpl.java:416)
      org.apache.activemq.artemis.integration.FileBroker.stop(FileBroker.java:79)
      org.apache.activemq.artemis.cli.commands.Run.stopServerAndComponenets(Run.java:109)
      org.apache.activemq.artemis.cli.commands.Run.access$000(Run.java:41)
      org.apache.activemq.artemis.cli.commands.Run$2.run(Run.java:172)
      ===============================================================================
      AMQ119002: Thread Thread[Finalizer,8,system] name = Finalizer id = 3 group = java.lang.ThreadGroup[name=system,maxpri=10]
      
      java.lang.Object.wait(Native Method)
      java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
      java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
      java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-4 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-4 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 22 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-14 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-14 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 113 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (activemq-netty-threads-1995250556),5,activemq-netty-threads-1995250556] name = Thread-0 (activemq-netty-threads-1995250556) id = 28 group = java.lang.ThreadGroup[name=activemq-netty-threads-1995250556,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[ActiveMQ Artemis Server Shutdown Timer,5,main] name = ActiveMQ Artemis Server Shutdown Timer id = 10 group = java.lang.ThreadGroup[name=main,maxpri=10]
      
      java.lang.Object.wait(Native Method)
      java.util.TimerThread.mainLoop(Timer.java:552)
      java.util.TimerThread.run(Timer.java:505)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-4 (ActiveMQ-scheduled-threads-1089504328),5,ActiveMQ-scheduled-threads-1089504328] name = Thread-4 (ActiveMQ-scheduled-threads-1089504328) id = 90 group = java.lang.ThreadGroup[name=ActiveMQ-scheduled-threads-1089504328,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-0 (activemq-netty-threads-1490509465),5,activemq-netty-threads-1490509465] name = Thread-0 (activemq-netty-threads-1490509465) id = 64 group = java.lang.ThreadGroup[name=activemq-netty-threads-1490509465,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-2 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-2 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 20 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-20 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-20 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 119 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      java.lang.Thread.dumpThreads(Native Method)
      java.lang.Thread.getAllStackTraces(Thread.java:1603)
      org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.threadDump(ActiveMQServerImpl.java:667)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.lockDelivery(ServerConsumerImpl.java:648)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.setStarted(ServerConsumerImpl.java:621)
      org.apache.activemq.artemis.core.server.impl.ServerConsumerImpl.close(ServerConsumerImpl.java:438)
      org.apache.activemq.artemis.core.protocol.proton.plug.ProtonSessionIntegrationCallback$2.run(ProtonSessionIntegrationCallback.java:255)
      org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:103)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-19 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-19 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 118 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-28 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-28 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 127 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-3 (ActiveMQ-scheduled-threads-1089504328),5,ActiveMQ-scheduled-threads-1089504328] name = Thread-3 (ActiveMQ-scheduled-threads-1089504328) id = 89 group = java.lang.ThreadGroup[name=ActiveMQ-scheduled-threads-1089504328,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-3 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-3 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 21 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-23 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-23 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 122 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-24 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-24 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 123 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-1 (ActiveMQ-scheduled-threads-1089504328),5,ActiveMQ-scheduled-threads-1089504328] name = Thread-1 (ActiveMQ-scheduled-threads-1089504328) id = 24 group = java.lang.ThreadGroup[name=ActiveMQ-scheduled-threads-1089504328,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
      java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-17 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-17 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 116 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-4 (activemq-netty-threads-1537471098),5,activemq-netty-threads-1537471098] name = Thread-4 (activemq-netty-threads-1537471098) id = 56 group = java.lang.ThreadGroup[name=activemq-netty-threads-1537471098,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-3 (activemq-netty-threads-1537471098),5,activemq-netty-threads-1537471098] name = Thread-3 (activemq-netty-threads-1537471098) id = 55 group = java.lang.ThreadGroup[name=activemq-netty-threads-1537471098,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-2 (activemq-netty-threads-1537471098),5,activemq-netty-threads-1537471098] name = Thread-2 (activemq-netty-threads-1537471098) id = 54 group = java.lang.ThreadGroup[name=activemq-netty-threads-1537471098,maxpri=10]
      
      sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
      sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
      sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:685)
      io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:345)
      io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-18 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-18 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 117 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[SIGINT handler,9,system] name = SIGINT handler id = 130 group = java.lang.ThreadGroup[name=system,maxpri=10]
      
      java.lang.Object.wait(Native Method)
      java.lang.Thread.join(Thread.java:1245)
      java.lang.Thread.join(Thread.java:1319)
      java.lang.ApplicationShutdownHooks.runHooks(ApplicationShutdownHooks.java:106)
      java.lang.ApplicationShutdownHooks$1.run(ApplicationShutdownHooks.java:46)
      java.lang.Shutdown.runHooks(Shutdown.java:123)
      java.lang.Shutdown.sequence(Shutdown.java:167)
      java.lang.Shutdown.exit(Shutdown.java:212)
      java.lang.Terminator$1.handle(Terminator.java:52)
      sun.misc.Signal$1.run(Signal.java:212)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-25 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-25 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 124 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      org.proton.plug.handler.impl.ProtonHandlerImpl.flush(ProtonHandlerImpl.java:281)
      org.proton.plug.context.AbstractConnectionContext.flush(AbstractConnectionContext.java:132)
      org.apache.activemq.artemis.core.protocol.proton.ActiveMQProtonRemotingConnection.flush(ActiveMQProtonRemotingConnection.java:123)
      org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl$FailureCheckAndFlushThread$1.run(RemotingServiceImpl.java:703)
      org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:103)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119002: Thread Thread[Thread-26 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569),5,ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569] name = Thread-26 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569) id = 125 group = java.lang.ThreadGroup[name=ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@3d8314f0-19986569,maxpri=10]
      
      sun.misc.Unsafe.park(Native Method)
      java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
      java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
      java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      java.lang.Thread.run(Thread.java:745)
      ===============================================================================
      AMQ119003: End Thread dump
      *******************************************************************************
      
      23:28:08,089 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:09,090 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:10,090 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:11,090 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:12,091 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:13,091 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:14,091 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:15,092 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:16,092 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:17,093 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:18,093 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:19,093 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:20,094 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:21,094 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:22,094 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:23,095 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:24,095 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:25,095 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:26,096 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:27,096 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:28,097 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:29,097 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:30,097 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:31,098 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:32,098 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:33,098 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:34,099 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:35,099 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:36,099 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:37,100 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:38,100 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:39,100 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:40,101 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:41,101 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:42,101 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:43,102 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:44,102 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:45,102 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:46,103 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:47,103 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:48,103 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:49,104 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:50,104 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:51,104 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:52,105 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:53,105 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:54,105 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:55,106 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:56,106 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:57,106 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:58,106 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:28:59,107 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:00,107 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:01,107 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:02,108 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:03,108 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:04,109 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:05,109 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:06,109 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:07,110 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:08,110 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:09,110 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:10,111 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:11,111 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:12,111 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      23:29:13,112 WARN  [org.apache.activemq.artemis.core.server] AMQ222174: Queue jms.queue.q1, on address=jms.queue.q1, is taking too long to flush deliveries. Watch out for frozen clients.
      

      I am not sure if this is issue with PerfTest or the broker. Or if it is an issue at all, given the Watch out for frozen clients. message. I will provide more logs (like debug logs) if you need it.

      CC Chuck Rolke

        Gliffy Diagrams

          Attachments

          1. Amqp.Net.dll
            217 kB
            Jiri Danek
          2. PerfTest.exe
            21 kB
            Jiri Danek

            Activity

              People

              • Assignee:
                martyn-taylor Martyn Taylor
                Reporter:
                jdanek Jiri Danek
                Tester:
                Jiri Danek
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: