Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-18962

SingletonPartitionTestCase#testSingletonService intermittently fails

    XMLWordPrintable

Details

    • ---
    • ---

    Description

      org.jboss.as.test.clustering.cluster.singleton.SingletonPartitionTestCase#testSingletonService intermittently fails with:

      org.junit.ComparisonFailure: Expected different provider node expected:<node-[2]> but was:<node-[1]>
        at org.junit.Assert.assertEquals(Assert.java:117)
        at org.jboss.as.test.clustering.cluster.singleton.SingletonPartitionTestCase.checkSingletonNode(SingletonPartitionTestCase.java:179)
        at org.jboss.as.test.clustering.cluster.singleton.SingletonPartitionTestCase.testSingletonService(SingletonPartitionTestCase.java:141)
        ...
      

      and standard output like:

      06:55:43,619 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (timeout-thread--p12-t1) ISPN000136: Error executing command PutKeyValueCommand on Cache 'http-remoting-connector', writing keys [node-2]: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 17 from node-2 after 17.5 seconds
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.impl.MultiTargetRequest.onTimeout(MultiTargetRequest.java:179)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:88)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:22)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
      &amp#27;node-1 &amp#27;06:55:43,621 WARN  [org.infinispan.CLUSTER] (timeout-thread--p12-t1) ISPN000071: Caught exception when handling command SingleRpcCommand{cacheName='http-remoting-connector', command=PutKeyValueCommand{key=node-2, value=node-2=[org.jboss.as.network.ClientMapping@42970be3], flags=[FORCE_SYNCHRONOUS], commandInvocationId=CommandInvocation:node-2:4, putIfAbsent=false, returnEntry=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{version=null, lifespan=-1, maxIdle=-1}, internalMetadata=null, successful=true, topologyId=37}}: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 17 from node-2 after 17.5 seconds
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.impl.MultiTargetRequest.onTimeout(MultiTargetRequest.java:179)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:88)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:22)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
      &amp#27;node-1 &amp#27;06:55:58,720 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (timeout-thread--p16-t1) ISPN000136: Error executing command ComputeCommand on Cache 'default', writing keys [service jboss.test2.service.default.singleton]: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 32 from node-2 after 17.5 seconds
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.impl.MultiTargetRequest.onTimeout(MultiTargetRequest.java:179)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:88)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:22)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
      &amp#27;node-1 &amp#27;06:55:58,721 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (timeout-thread--p16-t1) ISPN000136: Error executing command ComputeCommand on Cache 'default', writing keys [service jboss.test1.service.default.singleton]: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 33 from node-2 after 17.5 seconds
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.impl.MultiTargetRequest.onTimeout(MultiTargetRequest.java:179)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:88)
        at org.infinispan.core@14.0.21.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:22)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
      

      See https://ci.wildfly.org/test/-3163568781982631309?currentProjectId=WF_MainNightlyJobs where it fails rarely. In EAP QE CI it fails much more often.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              okotek@redhat.com Ondrej Kotek
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: