Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-8711

WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer random failures

    XMLWordPrintable

Details

    Description

      Most likely the BlockingLocalTopologyManager blocks state transfer for the CONFIG cache and that prevents the CONFIG entry iterator from finishing:

      19:39:52,601 TRACE (testng-Test:[]) [DistributedCacheStream] Distributed iterator invoked with rehash: true
      19:39:52,611 TRACE (testng-Test:[]) [ClusterStreamManagerImpl] Request: Test-NodeC-6083-1 is requesting 512 more entries from Test-NodeA-10673={0-3 5-6 12 14 16 18 20 22 25 27-28 30 33 37 39 41 43-46 48 50 52 57-58 64-70 72-77 80 82-83 85-87 89-91 94 97-99 102 106-107 111-112 116 118 121 124 129 131 134 136-140 142-144 147-148 154 156-161 164-167 170 173-180 183 185 187-189 194-195 199-202 204 207 210-212 214 216-217 219 222 230 232-234 238 240-242 245-246 248 253-254} in segments {0-3 5-6 12 14 16 18 20 22 25 27-28 30 33 37 39 41 43-46 48 50 52 57-58 64-70 72-77 80 82-83 85-87 89-91 94 97-99 102 106-107 111-112 116 118 121 124 129 131 134 136-140 142-144 147-148 154 156-161 164-167 170 173-180 183 185 187-189 194-195 199-202 204 207 210-212 214 216-217 219 222 230 232-234 238 240-242 245-246 248 253-254}
      19:39:52,611 TRACE (testng-Test:[]) [JGroupsTransport] Test-NodeC-6083 sending request 4 to Test-NodeA-10673: StreamIteratorRequestCommand{cacheName='org.infinispan.CONFIG'}
      19:40:22,821 DEBUG (testng-Test:[]) [PriorityMergingProcessor] Timeout encountered: signaled false, error null, queues [QueueSubscriber{queue.empty = true, done = true}, QueueSubscriber{queue.empty = true, done = false}, QueueSubscriber{queue.empty = true, done = true}]
      19:40:22,892 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer
      org.infinispan.manager.EmbeddedCacheManagerStartupException: org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart() on object of type GlobalConfigurationManagerImpl
      	at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:271) ~[classes/:?]
      	at org.infinispan.manager.DefaultCacheManager.start(DefaultCacheManager.java:671) ~[classes/:?]
      	at org.infinispan.test.MultipleCacheManagersTest.addClusterEnabledCacheManager(MultipleCacheManagersTest.java:223) ~[test-classes/:?]
      	at org.infinispan.test.MultipleCacheManagersTest.addClusterEnabledCacheManager(MultipleCacheManagersTest.java:205) ~[test-classes/:?]
      	at org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.addNode(WriteSkewDuringStateTransferTest.java:173) ~[test-classes/:?]
      	at org.infinispan.statetransfer.WriteSkewDuringStateTransferTest.testVersionsAfterStateTransfer(WriteSkewDuringStateTransferTest.java:96) ~[test-classes/:?]
      Caused by: org.infinispan.commons.CacheException: Unable to invoke method public void org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart() on object of type GlobalConfigurationManagerImpl
      	at org.infinispan.commons.util.SecurityActions.lambda$invokeAccessibly$0(SecurityActions.java:83) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.SecurityActions.doPrivileged(SecurityActions.java:71) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.SecurityActions.invokeAccessibly(SecurityActions.java:76) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:185) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:968) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.lambda$invokePrioritizedMethods$6(AbstractComponentRegistry.java:703) ~[classes/:?]
      	at org.infinispan.factories.SecurityActions.lambda$run$1(SecurityActions.java:72) ~[classes/:?]
      	at org.infinispan.security.Security.doPrivileged(Security.java:76) ~[classes/:?]
      	at org.infinispan.factories.SecurityActions.run(SecurityActions.java:71) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.invokePrioritizedMethods(AbstractComponentRegistry.java:696) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.postStart(AbstractComponentRegistry.java:620) ~[classes/:?]
      	at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:267) ~[classes/:?]
      	... 25 more
      Caused by: org.infinispan.util.concurrent.TimeoutException
      	at org.infinispan.stream.impl.PriorityMergingProcessor$MultiSubscriberIterator.getNext(PriorityMergingProcessor.java:179) ~[classes/:?]
      	at org.infinispan.commons.util.AbstractIterator.hasNext(AbstractIterator.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.stream.impl.DistributedCacheStream$RehashIterator.getNext(DistributedCacheStream.java:624) ~[classes/:?]
      	at org.infinispan.commons.util.AbstractIterator.hasNext(AbstractIterator.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.RemovableIterator.getNextFromIterator(RemovableIterator.java:27) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.RemovableIterator.hasNext(RemovableIterator.java:36) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.Closeables$IteratorAsCloseableIterator.hasNext(Closeables.java:116) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.RemovableIterator.getNextFromIterator(RemovableIterator.java:27) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.RemovableIterator.hasNext(RemovableIterator.java:36) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.IteratorMapper.hasNext(IteratorMapper.java:26) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.cache.impl.EncoderCache$EncoderIterator.hasNext(EncoderCache.java:727) ~[classes/:?]
      	at org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.postStart(GlobalConfigurationManagerImpl.java:74) ~[classes/:?]
      	at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source) ~[?:?]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_152]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_152]
      	at org.infinispan.commons.util.SecurityActions.lambda$invokeAccessibly$0(SecurityActions.java:79) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.SecurityActions.doPrivileged(SecurityActions.java:71) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.SecurityActions.invokeAccessibly(SecurityActions.java:76) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.commons.util.ReflectionUtil.invokeAccessibly(ReflectionUtil.java:185) ~[infinispan-commons-9.2.0-SNAPSHOT.jar:9.2.0-SNAPSHOT]
      	at org.infinispan.factories.AbstractComponentRegistry$PrioritizedMethod.invoke(AbstractComponentRegistry.java:968) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.lambda$invokePrioritizedMethods$6(AbstractComponentRegistry.java:703) ~[classes/:?]
      	at org.infinispan.factories.SecurityActions.lambda$run$1(SecurityActions.java:72) ~[classes/:?]
      	at org.infinispan.security.Security.doPrivileged(Security.java:76) ~[classes/:?]
      	at org.infinispan.factories.SecurityActions.run(SecurityActions.java:71) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.invokePrioritizedMethods(AbstractComponentRegistry.java:696) ~[classes/:?]
      	at org.infinispan.factories.AbstractComponentRegistry.postStart(AbstractComponentRegistry.java:620) ~[classes/:?]
      	at org.infinispan.factories.GlobalComponentRegistry.start(GlobalComponentRegistry.java:267) ~[classes/:?]
      	... 25 more
      

      Attachments

        Issue Links

          Activity

            People

              dberinde@redhat.com Dan Berindei (Inactive)
              dberinde@redhat.com Dan Berindei (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: