Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-6983

ThreeNodesSplitAndMergeTest random failures

    XMLWordPrintable

Details

    Description

      When merging the partitions, the stable topology is updated last. So when the merge is done and the cache is balanced, we cannot assume that the stable topology was updated already:

      10:31:19,576 INFO  (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [CLUSTER] ISPN000336: Finished cluster-wide rebalance for cache ___defaultcache, topology id = 12
      10:31:19,578 DEBUG (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}, availability mode = AVAILABLE
      10:31:19,579 DEBUG (remote-thread-TNRSAMT-NodeD-p47035-t6:[___defaultcache]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}
      10:31:19,579 TRACE (transport-thread-TNRSAMT-NodeD-p47037-t3:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}
      10:31:19,581 TRACE (OOB-2,TNRSAMT-NodeE-56471:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=TNRSAMT-NodeD-51650, joinInfo=null, topologyId=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], throwable=null, viewId=15} [sender=TNRSAMT-NodeD-51650]
      10:31:19,590 TRACE (OOB-2,TNRSAMT-NodeE-56471:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=TNRSAMT-NodeD-51650, joinInfo=null, topologyId=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, availabilityMode=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], throwable=null, viewId=15} [sender=TNRSAMT-NodeD-51650]
      10:31:19,591 ERROR (testng-TNRSAMT:[]) [TestSuiteProgress] Test failed: org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge1
      java.lang.AssertionError: Sets differ: expected [TNRSAMT-NodeD-51650, TNRSAMT-NodeE-56471, TNRSAMT-NodeF-19367] but got [TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367]
      	at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?]
      	at org.testng.Assert.assertEquals(Assert.java:806) ~[testng-6.8.8.jar:?]
      	at org.testng.Assert.assertEquals(Assert.java:784) ~[testng-6.8.8.jar:?]
      	at org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge(ThreeNodesSplitAndMergeTest.java:106) ~[test-classes/:?]
      	at org.infinispan.partitionhandling.TNRSAMT.testSplitAndMerge1(ThreeNodesSplitAndMergeTest.java:29) ~[test-classes/:?]
      10:31:19,595 TRACE (transport-thread-TNRSAMT-NodeF-p47149-t1:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}
      10:31:19,596 TRACE (transport-thread-TNRSAMT-NodeE-p47049-t6:[Topology-___defaultcache]) [LocalTopologyManagerImpl] Updating stable topology for cache ___defaultcache: CacheTopology{id=13, rebalanceId=5, currentCH=ReplicatedConsistentHash{ns = 256, owners = (3)[TNRSAMT-NodeD-51650: 82, TNRSAMT-NodeF-19367: 90, TNRSAMT-NodeE-56471: 84]}, pendingCH=null, unionCH=null, actualMembers=[TNRSAMT-NodeD-51650, TNRSAMT-NodeF-19367, TNRSAMT-NodeE-56471], persistentUUIDs=[2ce986af-9b26-4b1b-9b0c-bdd51fc591d3, ebe7eef6-3916-4061-b6f7-ce4fb35253f1, 8f6ef9d0-c5a8-4ac2-af54-4c7d07726f83]}
      

      Attachments

        Activity

          People

            dberinde@redhat.com Dan Berindei (Inactive)
            dberinde@redhat.com Dan Berindei (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: