Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-8002

ScatteredStreamIteratorTest.waitUntilProcessingResults random failures

    Details

      Description

      20:38:39,442 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.scattered.stream.ScatteredStreamIteratorTest.waitUntilProcessingResults[SCATTERED_SYNC, tx=false]
      java.lang.NullPointerException: null
      	at org.infinispan.stream.DistributedStreamIteratorTest.waitUntilProcessingResults(DistributedStreamIteratorTest.java:207) ~[test-classes/:?]
      

      Looks like segments ScatteredVersionManager blocks access to segments 10 and 12, and they are never suspected or retried:

      20:38:38,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-0 completed segments [6, 7, 13, 14, 15] with [] suspected segments
      20:38:38,248 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 10, 11, 12] lost segments for Test-NodeBD-1062-0
      20:38:38,249 TRACE (transport-thread-Test-NodeBD-p13301-t4:[Topology-org.infinispan.scattered.stream.Test]) [ScatteredVersionManager] Node Test-NodeBD-1062 blocks access to segment 10
      20:38:38,253 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeBF-40292={8-9 11}} for id Test-NodeBD-1062-1
      20:38:39,209 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-1 completed segments [] with [8, 9, 11] suspected segments
      20:38:39,302 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found [0, 1, 2, 3, 4, 5, 8, 9, 11] lost segments for Test-NodeBD-1062-1
      20:38:39,420 TRACE (remote-thread-Test-NodeBF-p13315-t6:[]) [LocalStreamManagerImpl] Request Test-NodeBD-1062-2 completed segments [8, 9, 11] with [] suspected segments
      20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 2, 3, 4, 5]
      20:38:39,436 TRACE (async-thread-Test-NodeBD-p13302-t1:[])
      

      Please also add a toString() method in the stream commands, seeing the segments in the requests and responses would make it easier to follow the logs.

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                rvansa Radim Vansa
                Reporter:
                dan.berindei Dan Berindei
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: