Receiver for hostname: messaging-06, number or received messages:921, message id = ID:a6b90a3a-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:922, message id = ID:9a01bab6-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:923, message id = ID:9a056438-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:924, message id = ID:9a090dba-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:925, message id = ID:9a0c902c-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:926, message id = ID:9a1039ae-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:927, message id = ID:9a13bc20-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:928, message id = ID:9a178cb2-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:929, message id = ID:9a1b0f24-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:930, message id = ID:9a1eb8a6-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:931, message id = ID:9a226228-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:932, message id = ID:9a25e49a-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:933, message id = ID:9a298e1c-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:934, message id = ID:9a2d379e-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:935, message id = ID:9a30e120-3c6a-11e1-9bcf-001b21862579 COMMIT Receiver for hostname: messaging-06, number or received messages:936, message id = ID:9a348aa2-3c6a-11e1-9bcf-001b21862579 COMMIT ERROR = Receiver for hostname: messaging-06 Exception thrown during ack for message: 937, HornetQMessage[ID:9a380d14-3c6a-11e1-9bcf-001b21862579]:PERSISTENT exception message: Timed out waiting for response when sending packet 43 ERROR = Receiver for hostname: messaging-06 Exception thrown during ack for message: 937, HornetQMessage[ID:9a3bb696-3c6a-11e1-9bcf-001b21862579]:PERSISTENT exception message: Timed out waiting for response when sending packet 41 ERROR = Receiver for hostname: messaging-06 Exception thrown during ack for message: 937, HornetQMessage[ID:9a3f3908-3c6a-11e1-9bcf-001b21862579]:PERSISTENT exception message: Timed out waiting for response when sending packet 41 Jan 11, 2012 10:42:55 AM org.hornetq.core.logging.impl.JULLogDelegate warn WARNING: Connection failure has been detected: Did not receive data from server for org.hornetq.core.remoting.impl.netty.NettyConnection@687bc899[local= /10.16.100.18:39781, remote=messaging-06/10.16.100.16:5445] [code=3] ERROR = Receiver for hostname: messaging-06 Exception thrown during ack for message: 937, HornetQMessage[ID:9a42bb7a-3c6a-11e1-9bcf-001b21862579]:PERSISTENT exception message: Connection failure detected. Unblocking a blocking call that will never get a response ^\2012-01-11 10:47:37 Full thread dump Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode): "Thread-1 (HornetQ-client-global-scheduled-threads-1811924614)" daemon prio=10 tid=0x00007f5690014800 nid=0xa9e waiting on condition [0x00007f56ecb4d000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x0000000797de31f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:662) "Old I/O client worker ([id: 0x3e018c74, /10.16.100.18:39784 => messaging-06/10.16.100.16:5445])" daemon prio=10 tid=0x00007f5690013800 nid=0xa9d runnable [0x00007f56ecc4e000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.net.SocketInputStream.read(SocketInputStream.java:182) at java.io.FilterInputStream.read(FilterInputStream.java:66) at java.io.PushbackInputStream.read(PushbackInputStream.java:122) at org.jboss.netty.channel.socket.oio.OioWorker.run(OioWorker.java:76) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46) at org.jboss.netty.util.VirtualExecutorService$ChildExecutorRunnable.run(VirtualExecutorService.java:181) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) "Thread-0 (HornetQ-client-global-scheduled-threads-1811924614)" daemon prio=10 tid=0x00007f56f05e4000 nid=0x956 waiting on condition [0x00007f56ece50000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x0000000797de31f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:662) "RMI Scheduler(0)" daemon prio=10 tid=0x00007f56f062a800 nid=0x954 waiting on condition [0x00007f56ed052000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000007972b0bf8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) at java.util.concurrent.DelayQueue.take(DelayQueue.java:160) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:662) "GC Daemon" daemon prio=10 tid=0x00007f56f05fa000 nid=0x953 in Object.wait() [0x00007f56ed153000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c5817d78> (a sun.misc.GC$LatencyLock) at sun.misc.GC$Daemon.run(GC.java:100) - locked <0x00000006c5817d78> (a sun.misc.GC$LatencyLock) "RMI RenewClean-[messaging-06:1098]" daemon prio=10 tid=0x00007f56f0623800 nid=0x952 in Object.wait() [0x00007f56ed254000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c581fd68> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) - locked <0x00000006c581fd68> (a java.lang.ref.ReferenceQueue$Lock) at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516) at java.lang.Thread.run(Thread.java:662) "Low Memory Detector" daemon prio=10 tid=0x00007f56f009c800 nid=0x94e runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "CompilerThread1" daemon prio=10 tid=0x00007f56f009a800 nid=0x94d waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "CompilerThread0" daemon prio=10 tid=0x00007f56f0097800 nid=0x94c waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Signal Dispatcher" daemon prio=10 tid=0x00007f56f0095800 nid=0x94b waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Finalizer" daemon prio=10 tid=0x00007f56f0078800 nid=0x94a in Object.wait() [0x00007f56eddca000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c5800250> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) - locked <0x00000006c5800250> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) "Reference Handler" daemon prio=10 tid=0x00007f56f0076800 nid=0x949 in Object.wait() [0x00007f56edecb000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000006c5827db0> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x00000006c5827db0> (a java.lang.ref.Reference$Lock) "main" prio=10 tid=0x00007f56f000b000 nid=0x93f in Object.wait() [0x00007f56f7e39000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000007997423f8> (a org.hornetq.core.client.impl.ClientConsumerImpl) at org.hornetq.core.client.impl.ClientConsumerImpl.receive(ClientConsumerImpl.java:252) - locked <0x00000007997423f8> (a org.hornetq.core.client.impl.ClientConsumerImpl) at org.hornetq.core.client.impl.ClientConsumerImpl.receive(ClientConsumerImpl.java:389) at org.hornetq.jms.client.HornetQMessageConsumer.getMessage(HornetQMessageConsumer.java:224) at org.hornetq.jms.client.HornetQMessageConsumer.receive(HornetQMessageConsumer.java:128) at org.jboss.qa.hornetq.NewTestConsumer.receiveMessage(NewTestConsumer.java:109) at org.jboss.qa.hornetq.NewTestConsumer.startClient(NewTestConsumer.java:61) at org.jboss.qa.hornetq.NewTestConsumer.main(NewTestConsumer.java:24) "VM Thread" prio=10 tid=0x00007f56f0070000 nid=0x948 runnable "GC task thread#0 (ParallelGC)" prio=10 tid=0x00007f56f001e000 nid=0x940 runnable "GC task thread#1 (ParallelGC)" prio=10 tid=0x00007f56f001f800 nid=0x941 runnable "GC task thread#2 (ParallelGC)" prio=10 tid=0x00007f56f0021800 nid=0x942 runnable "GC task thread#3 (ParallelGC)" prio=10 tid=0x00007f56f0023800 nid=0x943 runnable "GC task thread#4 (ParallelGC)" prio=10 tid=0x00007f56f0025000 nid=0x944 runnable "GC task thread#5 (ParallelGC)" prio=10 tid=0x00007f56f0027000 nid=0x945 runnable "GC task thread#6 (ParallelGC)" prio=10 tid=0x00007f56f0029000 nid=0x946 runnable "GC task thread#7 (ParallelGC)" prio=10 tid=0x00007f56f002a800 nid=0x947 runnable "VM Periodic Task Thread" prio=10 tid=0x00007f56f00af800 nid=0x94f waiting on condition JNI global references: 1490 Heap PSYoungGen total 93952K, used 54874K [0x00000007972b0000, 0x000000079db80000, 0x0000000800000000) eden space 80576K, 68% used [0x00000007972b0000,0x000000079a8468e8,0x000000079c160000) from space 13376K, 0% used [0x000000079c160000,0x000000079c160000,0x000000079ce70000) to space 13376K, 0% used [0x000000079ce70000,0x000000079ce70000,0x000000079db80000) PSOldGen total 214656K, used 6649K [0x00000006c5800000, 0x00000006d29a0000, 0x00000007972b0000) object space 214656K, 3% used [0x00000006c5800000,0x00000006c5e7e5e0,0x00000006d29a0000) PSPermGen total 21248K, used 10077K [0x00000006c0600000, 0x00000006c1ac0000, 0x00000006c5800000) object space 21248K, 47% used [0x00000006c0600000,0x00000006c0fd7608,0x00000006c1ac0000)