Uploaded image for project: 'JBoss A-MQ'
  1. JBoss A-MQ
  2. ENTMQ-307 AMQP hardening
  3. ENTMQ-265

org.apache.activemq.transport.amqp.joram.JoramJmsTest hangs on several platforms

    XMLWordPrintable

Details

    • Sub-task
    • Resolution: Done
    • Major
    • JBoss A-MQ 6.1
    • JBoss A-MQ 6.0
    • tests
    • None

    Description

      Hangs typically occur in org.objectweb.jtests.jms.framework.PubSubTestCase.tearDown(PubSubTestCase.java:149), as in the stack dump below. For now I'll update the pom to exclude this test on Windows, AIX, and Solaris

      $ jstack 13316
      2013-04-02 21:50:02
      Full thread dump Java HotSpot(TM) Client VM (23.7-b01 mixed mode, sharing):

      "RMI RenewClean-[10.196.229.216:63530]" daemon prio=6 tid=0x0475c800 nid=0x3028 in Object.wait() [0x052ff000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x24260068> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
      • locked <0x24260068> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:535)
        at java.lang.Thread.run(Thread.java:722)

      "RMI TCP Connection(20)-127.0.0.1" daemon prio=6 tid=0x0475bc00 nid=0x4794 runnable [0x051ef000]
      java.lang.Thread.State: RUNNABLE
      at java.net.SocketInputStream.socketRead0(Native Method)
      at java.net.SocketInputStream.read(SocketInputStream.java:150)
      at java.net.SocketInputStream.read(SocketInputStream.java:121)
      at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
      at java.io.BufferedInputStream.read(BufferedInputStream.java:254)

      • locked <0x297f16e0> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:83)
        at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:808)
        at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:667)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)

      "RMI RenewClean-[10.196.229.216:62903]" daemon prio=6 tid=0x04759c00 nid=0x1c74 in Object.wait() [0x04d6f000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x297f1890> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
      • locked <0x297f1890> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:535)
        at java.lang.Thread.run(Thread.java:722)

      "ActiveMQ Transport: tcp:///127.0.0.1:62774@62771" daemon prio=6 tid=0x0475b000 nid=0x2240 runnable [0x0535f000]
      java.lang.Thread.State: RUNNABLE
      at java.net.SocketInputStream.socketRead0(Native Method)
      at java.net.SocketInputStream.read(SocketInputStream.java:150)
      at java.net.SocketInputStream.read(SocketInputStream.java:121)
      at org.apache.activemq.transport.tcp.TcpBufferedInputStream.fill(TcpBufferedInputStream.java:50)
      at org.apache.activemq.transport.tcp.TcpTransport$2.fill(TcpTransport.java:604)
      at org.apache.activemq.transport.tcp.TcpBufferedInputStream.readStream(TcpBufferedInputStream.java:72)
      at org.apache.activemq.transport.tcp.TcpBufferedInputStream.read(TcpBufferedInputStream.java:92)
      at org.apache.activemq.transport.tcp.TcpTransport$2.read(TcpTransport.java:594)
      at java.io.DataInputStream.readFully(DataInputStream.java:195)
      at org.fusesource.hawtbuf.Buffer.readFrom(Buffer.java:412)
      at org.apache.activemq.transport.amqp.AmqpWireFormat.unmarshal(AmqpWireFormat.java:58)
      at org.apache.activemq.transport.tcp.TcpTransport.readCommand(TcpTransport.java:221)
      at org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:213)
      at org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:196)
      at java.lang.Thread.run(Thread.java:722)

      "Thread-235" daemon prio=6 tid=0x04758400 nid=0x10ec runnable [0x05d0f000]
      java.lang.Thread.State: RUNNABLE
      at java.net.SocketInputStream.socketRead0(Native Method)
      at java.net.SocketInputStream.read(SocketInputStream.java:150)
      at java.net.SocketInputStream.read(SocketInputStream.java:121)
      at java.net.SocketInputStream.read(SocketInputStream.java:107)
      at org.apache.qpid.amqp_1_0.client.Connection.doRead(Connection.java:337)
      at org.apache.qpid.amqp_1_0.client.Connection.access$000(Connection.java:42)
      at org.apache.qpid.amqp_1_0.client.Connection$2.run(Connection.java:243)
      at java.lang.Thread.run(Thread.java:722)

      "Thread-234" daemon prio=6 tid=0x04756c00 nid=0x3604 runnable [0x049ef000]
      java.lang.Thread.State: RUNNABLE
      at java.util.AbstractCollection.isEmpty(AbstractCollection.java:86)
      at org.apache.qpid.amqp_1_0.framing.ConnectionHandler$SequentialBytesSource.closed(ConnectionHandler.java:377)
      at org.apache.qpid.amqp_1_0.framing.ConnectionHandler$BytesOutputHandler.run(ConnectionHandler.java:402)
      at java.lang.Thread.run(Thread.java:722)

      "RMI Reaper" prio=6 tid=0x04757800 nid=0x10d8 in Object.wait() [0x03f3f000]
      java.lang.Thread.State: WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x2947fb50> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
      • locked <0x2947fb50> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
        at java.lang.Thread.run(Thread.java:722)

      "ActiveMQ Transport Server: amqp://localhost:0" daemon prio=10 tid=0x0475b400 nid=0x23f0 runnable [0x05c2f000]
      java.lang.Thread.State: RUNNABLE
      at java.net.DualStackPlainSocketImpl.waitForNewConnection(Native Method)
      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:125)
      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:183)

      • locked <0x296ffeb0> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:522)
        at java.net.ServerSocket.accept(ServerSocket.java:490)
        at org.apache.activemq.transport.tcp.TcpTransportServer.run(TcpTransportServer.java:274)
        at java.lang.Thread.run(Thread.java:722)

      "ActiveMQ Transport Server Thread Handler: amqp://localhost:0" daemon prio=8 tid=0x04759000 nid=0x2cb8 waiting on condition [0x04fcf0
      java.lang.Thread.State: TIMED_WAITING (parking)
      at sun.misc.Unsafe.park(Native Method)

      • parking to wait for <0x296ff110> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at org.apache.activemq.transport.tcp.TcpTransportServer$1.run(TcpTransportServer.java:346)
        at java.lang.Thread.run(Thread.java:722)

      "RMI TCP Accept-1099" daemon prio=6 tid=0x0475a400 nid=0x14e4 runnable [0x0518f000]
      java.lang.Thread.State: RUNNABLE
      at java.net.DualStackPlainSocketImpl.accept0(Native Method)
      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:121)
      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:183)

      • locked <0x296ff288> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:522)
        at java.net.ServerSocket.accept(ServerSocket.java:490)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359)
        at java.lang.Thread.run(Thread.java:722)

      "ActiveMQ Broker[localhost] Scheduler" daemon prio=6 tid=0x04757000 nid=0x3a30 in Object.wait() [0x04f2f000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x296ff428> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:552)
      • locked <0x296ff428> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

      "RMI RenewClean-[10.196.229.216:62676]" daemon prio=6 tid=0x04735800 nid=0x3a64 in Object.wait() [0x04e9f000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x294e66b0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
      • locked <0x294e66b0> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:535)
        at java.lang.Thread.run(Thread.java:722)

      "RMI Scheduler(0)" daemon prio=6 tid=0x04720000 nid=0x1854 waiting on condition [0x04ddf000]
      java.lang.Thread.State: TIMED_WAITING (parking)
      at sun.misc.Unsafe.park(Native Method)

      • parking to wait for <0x2947fa70> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)

      "GC Daemon" daemon prio=2 tid=0x04668400 nid=0x42e4 in Object.wait() [0x04acf000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x294f88e8> (a sun.misc.GC$LatencyLock)
        at sun.misc.GC$Daemon.run(GC.java:117)
      • locked <0x294f88e8> (a sun.misc.GC$LatencyLock)

      "RMI TCP Accept-0" daemon prio=6 tid=0x04673c00 nid=0x3b88 runnable [0x04d0f000]
      java.lang.Thread.State: RUNNABLE
      at java.net.DualStackPlainSocketImpl.accept0(Native Method)
      at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:121)
      at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:183)

      • locked <0x294e6960> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:522)
        at java.net.ServerSocket.accept(ServerSocket.java:490)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359)
        at java.lang.Thread.run(Thread.java:722)

      "Service Thread" daemon prio=6 tid=0x01cc3c00 nid=0x1d84 runnable [0x00000000]
      java.lang.Thread.State: RUNNABLE

      "C1 CompilerThread0" daemon prio=10 tid=0x01cb6000 nid=0xf68 waiting on condition [0x00000000]
      java.lang.Thread.State: RUNNABLE

      "Attach Listener" daemon prio=10 tid=0x01cb5000 nid=0x27ac waiting on condition [0x00000000]
      java.lang.Thread.State: RUNNABLE

      "Signal Dispatcher" daemon prio=10 tid=0x01cab400 nid=0x4a58 runnable [0x00000000]
      java.lang.Thread.State: RUNNABLE

      "Finalizer" daemon prio=8 tid=0x01ca0000 nid=0x1de8 in Object.wait() [0x03ecf000]
      java.lang.Thread.State: WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x293c72c0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
      • locked <0x293c72c0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)

      "Reference Handler" daemon prio=10 tid=0x01c9b400 nid=0x3310 in Object.wait() [0x0406f000]
      java.lang.Thread.State: WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x293c7348> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:503)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
      • locked <0x293c7348> (a java.lang.ref.Reference$Lock)

      "main" prio=6 tid=0x01c03000 nid=0x3ed8 in Object.wait() [0x0018f000]
      java.lang.Thread.State: WAITING (on object monitor)
      at java.lang.Object.wait(Native Method)

      • waiting on <0x29762f48> (a org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.qpid.amqp_1_0.client.Connection.close(Connection.java:370)
      • locked <0x29762f48> (a org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
        at org.apache.qpid.amqp_1_0.jms.impl.ConnectionImpl.close(ConnectionImpl.java:287)
      • locked <0x29762fb8> (a java.lang.Object)
        at org.objectweb.jtests.jms.framework.PubSubTestCase.tearDown(PubSubTestCase.java:149)
        at junit.framework.TestCase.runBare(TestCase.java:146)
        at junit.framework.TestResult$1.protect(TestResult.java:122)
        at junit.framework.TestResult.runProtected(TestResult.java:142)
        at junit.framework.TestResult.run(TestResult.java:125)
        at junit.framework.TestCase.run(TestCase.java:129)
        at junit.framework.TestSuite.runTest(TestSuite.java:255)
        at junit.framework.TestSuite.run(TestSuite.java:250)
        at junit.framework.TestSuite.runTest(TestSuite.java:255)
        at junit.framework.TestSuite.run(TestSuite.java:250)
        at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
        at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
        at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
        at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175)
        at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68)

      "VM Thread" prio=10 tid=0x01c9a000 nid=0x21c4 runnable

      "VM Periodic Task Thread" prio=10 tid=0x01cc6000 nid=0x245c waiting on condition

      JNI global references: 313

      Attachments

        Activity

          People

            Unassigned Unassigned
            kearls@redhat.com Kevin Earls (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: